-- Logs begin at Wed 2022-07-20 08:34:32 UTC, end at Wed 2022-07-20 09:35:14 UTC. -- Jul 20 09:03:58.823778 dv-cinder-843309-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 09:03:58.832428 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 09:03:58 2022] *** Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: nodename: dv-cinder-843309-5-iscsi Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: machine: x86_64 Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: clock source: unix Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: pcre jit disabled Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: detected number of CPU cores: 4 Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: current working directory: / Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: detected binary path: /usr/bin/uwsgi-core Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: your processes number limit is 47680 Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: your memory page size is 4096 bytes Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: detected max file descriptor number: 2048 Jul 20 09:03:58.834429 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: lock engine: pthread robust mutexes Jul 20 09:03:58.835358 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: thunder lock: enabled Jul 20 09:03:58.835358 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 09:03:58.835358 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 09:03:58.878683 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: Python main interpreter initialized at 0x56393d68e9c0 Jul 20 09:03:58.878836 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: python threads support enabled Jul 20 09:03:58.878836 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: your server socket listen backlog is limited to 100 connections Jul 20 09:03:58.878836 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: your mercy for graceful operations on workers is 90 seconds Jul 20 09:03:58.879054 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 09:03:58.879129 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: *** Operational MODE: preforking *** Jul 20 09:03:58.879366 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: *** uWSGI is running in multiple interpreter mode *** Jul 20 09:03:58.879366 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: spawned uWSGI master process (pid: 103316) Jul 20 09:03:58.879563 dv-cinder-843309-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 09:03:58.880566 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: spawned uWSGI worker 1 (pid: 103317, cores: 1) Jul 20 09:03:58.880566 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: spawned uWSGI worker 2 (pid: 103318, cores: 1) Jul 20 09:03:58.880566 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 09:03:59.547765 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:03:59.550870 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:04:00.679256 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:04:00.679256 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: from cryptography.utils import int_from_bytes Jul 20 09:04:00.679976 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:04:00.679976 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: from cryptography.utils import int_from_bytes Jul 20 09:04:00.682386 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:04:00.682386 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: from cryptography.utils import int_from_bytes Jul 20 09:04:00.682807 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:04:00.682807 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: from cryptography.utils import int_from_bytes Jul 20 09:04:03.151784 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:04:03.152388 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:04:03.152536 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:04:03.152892 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:04:03.153143 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:04:03.153520 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.153839 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.154157 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.154282 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:04:03.154631 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.154736 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:04:03.154816 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.155082 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:04:03.155171 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.155410 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.155503 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:04:03.155688 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:04:03.155779 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156032 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156117 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156288 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156393 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156594 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156690 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156910 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-5-iscsi {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.156997 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.157226 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.157319 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.157526 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.157620 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.157830 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.157924 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.158140 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.158226 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.158439 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.158527 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.158781 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.158872 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.159083 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.159194 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.159426 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-5-iscsi {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.159573 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.159749 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.159997 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.160131 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.160294 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.160386 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.160602 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.160704 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.160936 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.161029 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.161244 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.161358 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.161549 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.161646 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.161862 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.162051 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.162171 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.162363 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.162454 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.162670 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.162801 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.163001 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.163230 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-5-iscsi {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.163534 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.163636 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.163854 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.163949 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.164160 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.164263 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.164478 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.164567 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.164789 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.164891 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.165109 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.165195 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.165418 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.165529 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.165759 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.165871 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-5-iscsi {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.166057 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.166145 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.166377 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.166475 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.166701 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.166803 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167019 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167140 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167333 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167454 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167630 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167765 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.167934 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.168086 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.168236 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.168409 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.168546 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.168720 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.168864 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169049 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169141 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169361 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169467 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169664 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169759 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.169979 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170066 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170280 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170380 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170589 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170703 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170876 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.170965 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.171107 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.171223 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.171419 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.171559 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.171731 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.171875 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172024 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172158 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172324 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172460 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172625 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172775 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.172921 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173054 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173212 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173346 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173481 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173624 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173763 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.173898 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174030 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174163 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174333 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174478 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174642 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174756 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.174976 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.175075 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.175283 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.175378 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.175591 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.175678 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.175899 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176007 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176204 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176303 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176506 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176602 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176809 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.176893 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.177126 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.177213 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.177428 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.177512 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.177741 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.177829 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.178050 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.178153 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.178349 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.178434 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.178650 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.179430 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.179533 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.179602 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.179811 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.179913 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180145 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180240 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180447 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180544 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180694 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180780 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.180988 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181087 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181286 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181378 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181596 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181682 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181895 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.181990 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.182195 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.182282 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.182494 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.182581 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.182878 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.182982 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.183181 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.183275 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.183461 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.183545 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.183763 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.183857 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184062 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184148 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184360 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184445 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184661 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184749 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.184961 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.185057 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.185259 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.185345 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.185557 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.185648 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.185863 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186005 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186168 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186255 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186464 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186564 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186787 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.186886 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187085 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187182 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187385 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187478 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187692 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187784 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.187989 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188072 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188287 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188380 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188600 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188684 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188895 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.188980 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.189191 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.189279 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.189504 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.189602 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.189802 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.189971 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.190103 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.190198 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.190412 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.190506 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.190724 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.190841 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191025 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191116 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191337 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191491 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191645 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191792 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.191934 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192068 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192201 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192349 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192625 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192758 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.192890 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193054 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193197 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193351 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193495 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193635 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193774 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.193928 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.194069 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.194237 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.195024 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.195161 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.195689 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.195800 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.195917 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196013 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196225 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196330 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196533 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196626 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196844 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.196978 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.197149 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.197245 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.197453 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.197541 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.197753 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.197852 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.198072 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.198159 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.198393 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.198479 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.198722 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.198827 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.199034 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.199120 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.199339 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.199433 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.199658 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:04:03.199753 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.199960 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200045 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200265 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200358 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200569 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200657 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200880 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.200967 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.201193 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.201286 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.201518 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.201617 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.201824 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.201911 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.202134 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.202234 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.202446 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.202535 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.202769 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.202884 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.203083 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.203172 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.203406 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.203493 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.203718 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.203806 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204020 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204112 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204340 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204427 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204670 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204765 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.204979 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.205073 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.205292 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.205377 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.205603 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.205689 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.205908 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.206003 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.206214 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.206361 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.206517 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.206648 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.206837 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207066 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207205 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207335 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207467 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207614 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207755 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.207902 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208043 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208176 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208338 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208485 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208644 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208785 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.208953 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.209087 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.209259 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.209395 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.209602 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.209739 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.209899 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.210069 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.210292 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.210537 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.210639 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.210990 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.211076 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.211298 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.211384 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.211609 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.211725 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.211912 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212023 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212213 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212301 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212512 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212609 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212809 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.212905 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.213377 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.213505 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.213620 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.213709 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.213788 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.213874 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214003 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214089 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214302 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214390 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214630 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214750 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.214953 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215060 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215259 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215347 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215564 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215658 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215868 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.215962 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.216165 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.216251 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.216472 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.216570 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.216775 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.216869 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217072 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217157 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217388 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217476 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217693 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217788 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.217993 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.218079 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.218309 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.218395 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.218606 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.218744 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.218928 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219015 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219238 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219323 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219542 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219640 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219848 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.219945 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.220152 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.220248 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.220457 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.220543 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.220771 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.220857 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.221078 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.221164 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.221382 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.221468 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.221711 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.221852 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222016 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222103 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222319 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222405 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222633 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222748 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.222973 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223074 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223284 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223369 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223582 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223669 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223889 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.223989 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.224188 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.224275 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.224491 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.224578 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.224789 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.224884 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.225091 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.225178 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.225389 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.225483 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.226214 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.226441 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.226635 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.226803 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.226969 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.227136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.227270 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.227459 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.227587 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.227768 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.227892 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.228082 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.228185 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.228389 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.228476 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.228696 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.228784 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229003 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229098 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229313 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229412 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229619 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229705 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.229929 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230058 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230235 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230376 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230537 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230694 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230873 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.230962 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.231198 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.231286 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.231499 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.231601 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.231810 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.231942 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.232103 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.232187 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.232407 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.232493 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.232720 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.232807 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233025 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233111 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233338 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233423 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233640 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233727 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.233954 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234048 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234254 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234340 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234566 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234659 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234891 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.234976 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.235199 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.235295 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.235531 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.235626 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.235844 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.235929 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.236151 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.236243 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.236467 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.236567 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.236771 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.236858 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237079 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237172 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237382 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237467 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237685 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237779 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.237989 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.238089 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.238294 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.238380 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.238599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.238716 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.238923 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239016 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239234 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239320 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239536 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239629 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239850 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.239937 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.240152 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.240254 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.240461 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.240549 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.240756 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.240850 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.241060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.241155 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.241487 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.241577 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.241807 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.241892 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.242107 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.242193 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.242409 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.242501 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.242758 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.242921 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243064 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243201 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243377 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243554 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243695 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243840 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.243986 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244123 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244259 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244404 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244541 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244673 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244845 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.244979 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.245149 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.245307 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.245444 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.245578 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.245720 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.245856 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246027 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246167 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246327 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246463 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246791 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.246944 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247042 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247247 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247336 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247562 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247648 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247867 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.247962 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.248182 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.248270 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.248494 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.248590 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.248792 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.248880 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249089 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249197 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249403 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249497 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249701 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249796 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.249999 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.250174 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.250298 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.250399 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.250593 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.250709 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.250927 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.251013 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.251244 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.251344 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.251544 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.251632 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.251853 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252033 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252180 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252281 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252462 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252594 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252765 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.252851 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253070 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253172 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253374 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253461 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253676 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253768 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.253979 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.254068 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.254281 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.254376 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.254590 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.254704 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.254920 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255224 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255312 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255530 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255624 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255845 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.255933 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.256148 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.256234 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.256454 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.256541 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.256758 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.257364 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.257609 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.257744 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.257916 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.258150 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.258247 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.258471 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.258799 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.258890 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.259116 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.259213 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.259431 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.259519 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.259745 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.259840 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260059 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260154 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260372 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260466 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260680 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260767 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.260994 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.261095 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.261307 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.261397 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.261614 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.261714 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.261919 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.262004 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.262222 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.262311 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.262522 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.262808 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.262899 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.263138 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.263234 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.263440 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.263526 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.263740 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.263835 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264043 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264131 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264341 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264427 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264639 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264726 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.264937 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.265025 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.265242 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.265327 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.265551 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.265652 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.265850 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266013 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266155 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266242 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266453 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266539 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266789 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.266889 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267094 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267181 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267394 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267480 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267693 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267792 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.267991 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268079 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268292 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268376 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268598 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268682 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268901 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.268997 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.269206 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.269300 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.269520 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.269616 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.269824 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.269911 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.270127 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.270213 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.270431 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.270518 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.270751 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.270841 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271052 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271140 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271349 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271438 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271651 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271747 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.271951 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.272045 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.272244 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.272369 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.272659 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.272756 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.272984 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.273087 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.273289 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.273399 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.273591 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.273746 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.273893 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.274055 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.274198 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.274362 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.274496 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.274697 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.274829 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275021 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275138 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275327 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275443 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275632 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275729 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.275942 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276031 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276252 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276339 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276555 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276658 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276869 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.276972 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.277179 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.277274 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.277485 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.277581 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.277782 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.277868 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.278080 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.278167 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.278377 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.278475 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.278760 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.278850 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279001 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279095 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279299 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279387 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279606 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279692 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279907 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.279992 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.280205 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.280301 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.280503 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.280597 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.280804 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.280897 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281097 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281184 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281394 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281482 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281696 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281790 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.281999 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.282085 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.282305 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.282392 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.282602 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.282759 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.282929 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283018 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283226 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283314 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283524 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283620 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283821 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.283916 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.284120 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.284215 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.284415 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.284512 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.284711 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.284799 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285006 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285093 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285309 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285403 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285603 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285696 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285911 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.285996 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.286210 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.286296 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.286506 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.286593 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.286829 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.286934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.287130 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.287218 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.287437 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.287522 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.287743 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.287830 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.288046 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.288694 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.288897 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.288987 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.289211 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.289351 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.289521 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.289610 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.289825 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.289913 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.290129 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.290226 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.290435 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.290522 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.290757 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.290891 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291066 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291171 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291368 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291463 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291674 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291789 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.291971 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292076 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292267 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292377 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292582 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292680 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292885 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.292982 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.293189 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.293276 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.293502 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.293590 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.293818 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.293906 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.294136 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.294222 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.294434 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.294521 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.294758 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.294850 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295062 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295147 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295361 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295445 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295666 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295754 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.295968 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296054 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296269 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296361 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296572 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296659 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296872 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.296957 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.297179 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.297333 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.297477 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.297626 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.297762 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.297898 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298055 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298196 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298341 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298478 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298640 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298769 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.298979 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299281 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299369 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299576 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299671 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299878 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.299974 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.300175 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.300263 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.300478 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.300569 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.300776 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.300881 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.301084 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.301195 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.301395 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.301503 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.301706 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.301794 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302011 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302107 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302319 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302407 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302646 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302797 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.302979 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.303066 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.303289 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.303377 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.303586 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.303685 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.303951 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.304097 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.304264 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.304352 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.304645 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.304733 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.304951 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305038 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305249 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305349 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305546 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305679 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305853 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.305993 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.306171 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.306307 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.306469 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.306614 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.306790 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.306956 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.307088 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.307269 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.307399 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.307590 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.307712 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.307907 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.308001 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.308211 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.308383 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.308631 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.308718 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.308945 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309048 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309255 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309369 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309565 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309675 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309870 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.309967 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.310173 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.310280 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.310484 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.310599 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.310847 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.310949 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.311153 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.311241 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.311458 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.311546 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.311760 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.311856 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.312082 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.312176 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.312387 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.312475 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.312705 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.312799 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313013 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313127 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313311 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313439 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313626 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313745 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.313941 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.314161 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.314256 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.314474 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.314562 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.314808 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.314968 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.315133 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.315286 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.315454 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.315595 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.315775 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.315914 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.316080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.316233 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.316395 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.316532 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.316707 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.316831 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317030 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317125 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317354 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317486 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317667 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317757 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.317979 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.318068 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.318283 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.318371 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.318587 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.318692 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.318923 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.319023 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.319227 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.319826 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.320053 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.320235 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.320605 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.320925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321010 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321222 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321343 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321538 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321659 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321848 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.321987 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.322162 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.322316 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.322475 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.322626 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.322798 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.322961 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.323114 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.323274 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.323418 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.323588 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.323718 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.323896 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324016 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324222 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324309 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324529 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324639 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324849 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.324953 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.325150 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.325238 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.325457 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.325545 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.325762 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.325851 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.326068 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.326155 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.326391 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.326486 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.326713 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.326818 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327042 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327131 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327358 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327446 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327680 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327778 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.327976 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328071 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328275 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328363 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328578 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328675 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328875 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.328965 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.329172 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.329268 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.329469 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.329564 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.329770 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.329858 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330065 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330161 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330362 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330450 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330658 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330771 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.330991 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.331088 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.331288 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.331376 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.331604 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.331699 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.331905 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332006 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332203 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332334 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332502 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332592 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332797 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.332887 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.333131 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.333226 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.333427 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.333515 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.333750 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.333840 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.334060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.334149 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.334372 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.334460 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.334719 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.334824 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335068 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335190 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335375 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335464 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335682 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335772 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.335986 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.336075 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.336290 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.336397 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.336612 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.336701 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.336918 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337005 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337239 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337336 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337549 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337685 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337851 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.337938 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.338154 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.338254 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.338457 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.338553 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.338794 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.338884 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.339122 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.339303 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.339458 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.339627 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.339776 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.339935 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.340097 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.340241 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.340426 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.340547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.340735 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.340853 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.341059 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.341147 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.341380 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.341468 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.341697 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.341792 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342013 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342103 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342316 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342403 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342630 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342757 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.342967 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.343091 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.343285 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.343388 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.343601 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.343700 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.343908 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.344003 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.344215 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.344303 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.344523 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.344625 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.344828 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.345041 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.345177 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.345373 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.345470 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.345689 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.345777 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346003 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346097 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346315 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346412 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346631 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346740 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.346971 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347057 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347277 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347375 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347585 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347681 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347893 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.347989 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.348196 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.348285 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.348498 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.348585 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.348803 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.348890 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.349125 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.349216 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.349423 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.349510 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.349749 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.349837 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.350064 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.350159 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.350368 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.350454 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.351220 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.351334 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.351577 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.351668 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.351896 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.352183 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.352271 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.352496 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.352594 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.352816 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.352907 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.353132 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.353234 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.353447 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.353537 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.353755 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.353841 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.354068 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.354171 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.354380 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.354467 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.354691 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.354780 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355000 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355110 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355305 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355394 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355606 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355693 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.355902 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356000 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356214 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356304 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356522 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356619 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356820 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.356909 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.357133 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.357221 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.357437 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.357524 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.357954 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.358043 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.358267 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.358354 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.358585 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.358696 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.358927 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359016 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359244 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359340 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359555 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359642 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.359943 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.360169 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.360257 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.360469 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.360569 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.360772 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.360859 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361079 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361166 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361383 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361485 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361771 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.361979 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362066 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362279 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362377 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362579 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362732 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362899 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.362988 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.363200 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.363346 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.363482 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.363740 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.363830 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364089 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364186 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364383 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364478 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364678 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364766 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.364982 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365078 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365278 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365366 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365575 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365672 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365872 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.365968 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.366169 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.366390 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.366525 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.366614 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.366912 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367003 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367226 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367315 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367536 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367625 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367843 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.367970 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.368156 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.368243 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.368457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.368550 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.368768 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.368886 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369077 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369178 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369382 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369471 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369681 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369769 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.369991 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.370087 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.370296 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.370390 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.370599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.370707 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.370929 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371016 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371232 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371328 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371536 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371621 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371843 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.371929 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.372149 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.372374 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.372462 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.372699 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.372786 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373014 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373107 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373337 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373482 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373648 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373781 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.373947 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374090 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374236 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374381 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374516 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374666 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374859 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.374959 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.375162 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.375252 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.375466 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.375561 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.375769 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.375866 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376075 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376162 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376379 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376482 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376685 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376783 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.376988 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.377084 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.377292 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.377380 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.377592 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.377681 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.377895 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.378161 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.378257 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.378486 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.378649 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.378808 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.378898 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.379116 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.379205 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.379447 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.379547 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.379758 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.379847 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380062 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380149 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380370 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380467 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380678 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380765 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.380982 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.381069 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.381285 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.381374 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.381585 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.381672 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.382411 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.382547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.382755 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383010 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383101 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383339 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383430 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383660 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383766 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.383976 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.384064 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.384295 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.384384 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.384609 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.384698 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.384920 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385008 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385232 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385319 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385543 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385640 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385856 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.385944 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.386164 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.386252 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.386481 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.386577 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.386808 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.386910 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.387137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.387238 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.387458 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.387548 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.387771 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.387859 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388082 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388184 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388382 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388468 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388682 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388770 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.388982 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389078 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389287 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389376 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389601 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389690 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389905 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.389994 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.390204 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.390325 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.390502 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.390639 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.390831 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.390986 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.391127 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.391309 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.391427 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.391622 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.391724 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.391947 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392037 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392268 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392357 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392580 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392667 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392876 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.392963 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.393176 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.393263 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.393473 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.393597 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.393774 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.393891 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394071 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394162 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394374 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394465 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394690 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394793 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.394991 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395086 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395287 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395377 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395586 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395673 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395882 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.395978 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.396206 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.396294 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.396533 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.396632 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.396838 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.396941 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.397149 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.397235 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.397471 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.397557 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.397816 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398012 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398120 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398326 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398435 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398636 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398760 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.398977 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399066 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399283 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399370 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399591 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399691 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399897 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.399983 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.400203 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.400298 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.400509 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.400605 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.400815 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.400904 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.401127 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.401214 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.401428 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.401522 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.401735 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.401868 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402039 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402135 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402342 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402437 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402643 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402749 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.402990 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403141 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403293 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403433 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403599 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403735 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403907 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.403998 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.404233 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.404337 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.404541 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.404628 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.404846 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.404941 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.405151 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.405239 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.405457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.405551 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.405760 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.405858 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.406070 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.406157 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.406376 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.406463 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.406729 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.406845 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407019 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407109 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407331 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407438 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407641 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407816 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.407952 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408061 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408254 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408349 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408572 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408662 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408890 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.408977 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.409195 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.409283 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.409524 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.409614 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.409844 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.409932 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.410163 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.410249 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.410473 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.410562 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.410801 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.410892 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.411102 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.411191 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.411340 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103317) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:04:03.411430 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.411730 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.412043 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.412356 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.412671 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.412990 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.413835 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.414153 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.414471 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.414820 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.415151 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.415479 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.415792 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.416118 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.416447 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.416799 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.417115 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.417463 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.417792 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.418111 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.418427 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.418766 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:04:03.419014 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:04:03.474155 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO dbcounter [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Registered counter for database nova_api Jul 20 09:04:03.481820 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO dbcounter [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Registered counter for database nova_api Jul 20 09:04:03.588547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_db.sqlalchemy.engines [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.593083 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.594947 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writer thread running {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.599454 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writer thread running {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.650741 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.context [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea(cell1) {{(pid=103317) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:04:03.654731 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:04:03.655719 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.context [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea(cell1) {{(pid=103318) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:04:03.656241 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:04:03.657019 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:04:03.659189 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:04:03.659648 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:04:03.661134 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO dbcounter [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Registered counter for database nova_cell0 Jul 20 09:04:03.661237 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:04:03.661994 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:04:03.664667 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_concurrency.lockutils [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103318) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:04:03.664981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO dbcounter [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Registered counter for database nova_cell1 Jul 20 09:04:03.666633 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO dbcounter [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Registered counter for database nova_cell0 Jul 20 09:04:03.670486 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO dbcounter [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Registered counter for database nova_cell1 Jul 20 09:04:03.672293 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_db.sqlalchemy.engines [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.673795 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_db.sqlalchemy.engines [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.679785 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.680929 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writer thread running {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.681468 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.682562 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writer thread running {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.686954 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writer thread running {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.692044 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writer thread running {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.827265 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO dbcounter [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Registered counter for database nova_cell0 Jul 20 09:04:03.836329 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_db.sqlalchemy.engines [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103317) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.836885 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO dbcounter [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Registered counter for database nova_cell0 Jul 20 09:04:03.840644 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writer thread running {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:03.845423 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG oslo_db.sqlalchemy.engines [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:04:03.849753 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writer thread running {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:04:04.176272 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: WARNING keystonemiddleware.auth_token [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:04:04.182686 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:04:04.183742 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: WARNING keystonemiddleware.auth_token [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:04:04.190060 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:04:04.524376 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: WARNING keystonemiddleware.auth_token [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:04:04.530244 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: WARNING keystonemiddleware.auth_token [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:04:04.535500 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56393d68e9c0 pid: 103317 (default app) Jul 20 09:04:04.535650 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:04:04.537555 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:04:04.538872 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 Jul 20 09:04:04.539610 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Wed Jul 20 09:04:04 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:04:04.541679 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: WARNING keystonemiddleware.auth_token [None req-e9f90fdf-b822-4ea1-ad33-a97309374ab6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:04:04.547129 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56393d68e9c0 pid: 103318 (default app) Jul 20 09:05:20.870489 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:20.871546 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001647 Jul 20 09:05:20.872093 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:20.884826 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_api:SELECT=3 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:20.886249 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_cell1:SELECT=3 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:20.887248 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_cell0:SELECT=3 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:20.888452 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:21.750121 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-2edb6e1c-2075-4c28-814b-5347f0f8f91c admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:21.781296 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-2edb6e1c-2075-4c28-814b-5347f0f8f91c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.902619 Jul 20 09:05:21.782040 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jul 20 09:05:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:05:24.075442 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:24.076588 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-30ba4b7e-962c-42e6-a312-85b9f20832e3 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jul 20 09:05:24.077199 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:24.523699 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-073e9840-662e-4b03-b9fa-6f394ee29eb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "ram": 256, "disk": 1, "swap": 0, "name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:24.543467 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:05:24.543467 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: warnings.warn(msg) Jul 20 09:05:24.575469 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-073e9840-662e-4b03-b9fa-6f394ee29eb0 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492629 Jul 20 09:05:24.576106 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:24 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:05:24.808576 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-5287fccb-d275-4fe3-94d0-68ec16c72b77 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:24.811072 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:05:24.811072 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: warnings.warn(msg) Jul 20 09:05:24.826243 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_api:SELECT=3 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:24.826897 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_cell1:SELECT=3 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:24.827791 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_cell0:SELECT=3 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:24.828630 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:24.882609 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-5287fccb-d275-4fe3-94d0-68ec16c72b77 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.297391 Jul 20 09:05:24.883213 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jul 20 09:05:24 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:05:27.249192 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-073e9840-662e-4b03-b9fa-6f394ee29eb0 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:27.250213 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-073e9840-662e-4b03-b9fa-6f394ee29eb0 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 20 09:05:27.250804 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:27.928523 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-8e122d04-4d4a-45bd-903e-dfdc29840e3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "disk": 5, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds512M", "ram": 512}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:27.946806 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:05:27.946806 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: warnings.warn(msg) Jul 20 09:05:27.965113 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-8e122d04-4d4a-45bd-903e-dfdc29840e3e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.707588 Jul 20 09:05:27.966225 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:05:27.979708 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-100d0806-9dc0-458e-8935-c6827c21baf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:27.981342 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:05:27.981342 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: warnings.warn(msg) Jul 20 09:05:28.013503 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-100d0806-9dc0-458e-8935-c6827c21baf3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037521 Jul 20 09:05:28.014192 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jul 20 09:05:27 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:05:30.269845 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-8e122d04-4d4a-45bd-903e-dfdc29840e3e admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:30.271454 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-8e122d04-4d4a-45bd-903e-dfdc29840e3e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002073 Jul 20 09:05:30.271858 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:30.669774 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-22818856-7a87-483d-8de1-52fd7384e25a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "vcpus": 1, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "rxtx_factor": 1.0, "swap": 0}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:30.687819 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-22818856-7a87-483d-8de1-52fd7384e25a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.410222 Jul 20 09:05:30.688379 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:05:30.701369 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-226c06e9-ce1d-4c94-936f-d405749f398c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:30.722956 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-226c06e9-ce1d-4c94-936f-d405749f398c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025367 Jul 20 09:05:30.724242 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jul 20 09:05:30 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:05:32.956210 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-22818856-7a87-483d-8de1-52fd7384e25a admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:32.957227 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-22818856-7a87-483d-8de1-52fd7384e25a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 20 09:05:32.958336 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:33.402424 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-5dd6f805-249e-4406-894c-89622e31ff7e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G"}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:33.430942 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-5dd6f805-249e-4406-894c-89622e31ff7e admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.466607 Jul 20 09:05:33.431802 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:05:33.444695 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-59f92db4-b4a7-41bb-a7e5-8104723fcfd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:33.475373 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-59f92db4-b4a7-41bb-a7e5-8104723fcfd2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034314 Jul 20 09:05:33.476381 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jul 20 09:05:33 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:05:35.735642 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-5dd6f805-249e-4406-894c-89622e31ff7e admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:35.736643 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-5dd6f805-249e-4406-894c-89622e31ff7e admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 20 09:05:35.737037 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:36.166632 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1b64cf99-ccfb-414a-9e39-f73e74ff223b admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:36.186059 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1b64cf99-ccfb-414a-9e39-f73e74ff223b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442889 Jul 20 09:05:36.186709 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:05:36.199516 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-d328ef79-e3b9-4554-bcb6-fc150a58e1d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:36.223592 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-d328ef79-e3b9-4554-bcb6-fc150a58e1d4 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027419 Jul 20 09:05:36.230533 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1335 bytes} [Wed Jul 20 09:05:36 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:05:38.492527 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1b64cf99-ccfb-414a-9e39-f73e74ff223b admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:38.493551 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1b64cf99-ccfb-414a-9e39-f73e74ff223b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 20 09:05:38.494114 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:38.903947 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-a233440a-0c8d-45e4-bb2a-3db151876edb admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:38.927404 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-a233440a-0c8d-45e4-bb2a-3db151876edb admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.427455 Jul 20 09:05:38.927933 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jul 20 09:05:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:05:41.533961 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1b64cf99-ccfb-414a-9e39-f73e74ff223b admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:41.535013 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1b64cf99-ccfb-414a-9e39-f73e74ff223b admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jul 20 09:05:41.535449 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:05:41.965381 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-d956c011-6f6c-494e-9692-2b961043c059 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:41.982640 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-d956c011-6f6c-494e-9692-2b961043c059 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.441254 Jul 20 09:05:41.983246 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:41 2022] POST /compute/v2.1/flavors => generated 402 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:05:41.998248 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-5055ff7f-58ea-4f37-bea0-66661e709a37 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:42.021342 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-5055ff7f-58ea-4f37-bea0-66661e709a37 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026761 Jul 20 09:05:42.021925 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jul 20 09:05:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:05:44.523900 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-d956c011-6f6c-494e-9692-2b961043c059 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:44.524909 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-d956c011-6f6c-494e-9692-2b961043c059 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 20 09:05:44.525310 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:44.923332 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-8e302b64-1d66-4cd1-a6b0-2abec2e12ee3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "disk": 20, "id": "2"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:44.940339 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-8e302b64-1d66-4cd1-a6b0-2abec2e12ee3 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.409262 Jul 20 09:05:44.940828 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:05:44.952875 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-9c8ad800-2185-4489-a1fa-ef7583148026 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:44.975758 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-9c8ad800-2185-4489-a1fa-ef7583148026 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026523 Jul 20 09:05:44.976355 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jul 20 09:05:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:05:47.210576 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-8e302b64-1d66-4cd1-a6b0-2abec2e12ee3 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:47.211616 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-8e302b64-1d66-4cd1-a6b0-2abec2e12ee3 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 20 09:05:47.212158 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:47.617171 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-aa072fd6-1b4d-4cd9-b3f7-5d6678a5db16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "disk": 40, "swap": 0, "ram": 4096}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:47.650763 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-aa072fd6-1b4d-4cd9-b3f7-5d6678a5db16 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.432686 Jul 20 09:05:47.651821 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:05:47.665803 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-6d4c1f89-5b52-451d-8e75-d560b1605a79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:47.693573 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-6d4c1f89-5b52-451d-8e75-d560b1605a79 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031474 Jul 20 09:05:47.694835 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jul 20 09:05:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:05:49.962542 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-aa072fd6-1b4d-4cd9-b3f7-5d6678a5db16 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:49.963641 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-aa072fd6-1b4d-4cd9-b3f7-5d6678a5db16 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jul 20 09:05:49.964050 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:50.442001 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-fcc15c62-31be-468b-9fc3-d1e620b5ac61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "vcpus": 4}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:50.470435 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-fcc15c62-31be-468b-9fc3-d1e620b5ac61 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500194 Jul 20 09:05:50.478714 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:05:50.483832 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-31ddbab0-3ef9-4b47-9214-f0f3ad003fac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:50.506996 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-31ddbab0-3ef9-4b47-9214-f0f3ad003fac admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026975 Jul 20 09:05:50.507577 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jul 20 09:05:50 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:05:52.762822 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-fcc15c62-31be-468b-9fc3-d1e620b5ac61 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:05:52.764523 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-fcc15c62-31be-468b-9fc3-d1e620b5ac61 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002178 Jul 20 09:05:52.765349 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:05:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:05:53.216087 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-b03be550-a7e6-4993-8b70-771fdc419e4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "swap": 0, "disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:53.234893 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-b03be550-a7e6-4993-8b70-771fdc419e4a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.463348 Jul 20 09:05:53.243541 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1282 bytes} [Wed Jul 20 09:05:52 2022] POST /compute/v2.1/flavors => generated 408 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:05:53.248896 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-5e960619-eaa4-4015-ba82-290193a073c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:05:53.252466 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:05:53.276852 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-5e960619-eaa4-4015-ba82-290193a073c9 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031505 Jul 20 09:05:53.277441 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1332 bytes} [Wed Jul 20 09:05:53 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:06:12.854834 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-b03be550-a7e6-4993-8b70-771fdc419e4a admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:12.855857 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-b03be550-a7e6-4993-8b70-771fdc419e4a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 20 09:06:12.856254 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:12.867274 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:13.245682 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-e177a700-0f1a-4102-913d-9817d5c0d408 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:13.262357 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-e177a700-0f1a-4102-913d-9817d5c0d408 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.400354 Jul 20 09:06:13.262920 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jul 20 09:06:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:06:14.344084 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-b03be550-a7e6-4993-8b70-771fdc419e4a admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:14.345137 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-b03be550-a7e6-4993-8b70-771fdc419e4a admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 20 09:06:14.345563 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:14.920670 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-ff026e19-d2cc-44b3-9b41-524110d0e099 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:14.928744 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.wsgi [None req-ff026e19-d2cc-44b3-9b41-524110d0e099 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-ff026e19-d2cc-44b3-9b41-524110d0e099 admin admin] Request method failure captured: Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Accept: application/json Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Accept-Encoding: gzip, deflate Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Connection: keep-alive Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Content-Length: 0 Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Host: 10.222.0.44 Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Openstack-Api-Version: compute 2.90 Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Openstack-System-Scope: None Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: User-Agent: python-novaclient Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Auth-Token: gAAAAABi18WGLPBC08F1XkuMHEoiENaXctRTynTZ9HeGGFIGixSKwkwe-YXkWFmokU4qbiBNtS6uEqL2ACn0pREpPvynkX8Q2Rldyzi6UFxhcNYEgWSH_Dz1c_vOrz55wFbt-OV0CfNqZ3JzNYaq_SSqQvwqQh9w2rCOrdOu7lOxL6e4dikPuGY Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Domain-Id: None Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Domain-Name: None Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Identity-Status: Confirmed Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Is-Admin-Project: True Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Domain-Id: default Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Domain-Name: Default Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Name: admin Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Role: reader,admin,member Jul 20 09:06:14.932080 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Roles: reader,admin,member Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant: admin Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant-Name: admin Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User: admin Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Domain-Id: default Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Domain-Name: Default Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Id: d01511dd98c7416fb8387a8557165556 Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Name: admin Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: method: > Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: exception: Flavor 42 could not be found. Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: action_args: {'id': '42'} Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:06:14.933794 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:14.935009 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:14.936579 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-ff026e19-d2cc-44b3-9b41-524110d0e099 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:06:14.937842 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-ff026e19-d2cc-44b3-9b41-524110d0e099 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.436281 Jul 20 09:06:14.937842 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jul 20 09:06:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:14.944364 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-63d4b3a6-ff10-4f22-afb6-af26f2a27ac5 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:14.947473 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:06:14.966904 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-63d4b3a6-ff10-4f22-afb6-af26f2a27ac5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027078 Jul 20 09:06:14.967452 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jul 20 09:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:06:14.977520 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-adb2f42c-a5f5-4b13-9795-5369f879b157 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:14.999335 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-adb2f42c-a5f5-4b13-9795-5369f879b157 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025362 Jul 20 09:06:14.999889 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jul 20 09:06:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:06:15.010464 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-1835f772-eae4-42e8-b517-466d1297b407 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:15.016763 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.wsgi [None req-1835f772-eae4-42e8-b517-466d1297b407 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-1835f772-eae4-42e8-b517-466d1297b407 admin admin] Request method failure captured: Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Accept: application/json Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Accept-Encoding: gzip, deflate Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Connection: keep-alive Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Content-Length: 0 Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Host: 10.222.0.44 Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Openstack-Api-Version: compute 2.90 Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Openstack-System-Scope: None Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: User-Agent: python-novaclient Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Auth-Token: gAAAAABi18WGLPBC08F1XkuMHEoiENaXctRTynTZ9HeGGFIGixSKwkwe-YXkWFmokU4qbiBNtS6uEqL2ACn0pREpPvynkX8Q2Rldyzi6UFxhcNYEgWSH_Dz1c_vOrz55wFbt-OV0CfNqZ3JzNYaq_SSqQvwqQh9w2rCOrdOu7lOxL6e4dikPuGY Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Domain-Id: None Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Domain-Name: None Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Identity-Status: Confirmed Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Is-Admin-Project: True Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Domain-Id: default Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Domain-Name: Default Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Name: admin Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Role: reader,admin,member Jul 20 09:06:15.020060 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Roles: reader,admin,member Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant: admin Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant-Name: admin Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User: admin Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Domain-Id: default Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Domain-Name: Default Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Id: d01511dd98c7416fb8387a8557165556 Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Name: admin Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: method: > Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: exception: Flavor 42 could not be found. Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: action_args: {'id': '42'} Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:06:15.021617 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:15.022568 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:15.023854 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-1835f772-eae4-42e8-b517-466d1297b407 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:06:15.025066 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-1835f772-eae4-42e8-b517-466d1297b407 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015079 Jul 20 09:06:15.025066 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jul 20 09:06:15 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:15.999921 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-adb2f42c-a5f5-4b13-9795-5369f879b157 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:16.000960 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-adb2f42c-a5f5-4b13-9795-5369f879b157 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 20 09:06:16.001358 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:16.521789 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-e8636b17-98c5-469e-8336-abf156d27dbe admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:16.527765 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.wsgi [None req-e8636b17-98c5-469e-8336-abf156d27dbe admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-e8636b17-98c5-469e-8336-abf156d27dbe admin admin] Request method failure captured: Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Accept: application/json Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Accept-Encoding: gzip, deflate Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Connection: keep-alive Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Content-Length: 0 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Host: 10.222.0.44 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Openstack-Api-Version: compute 2.90 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Openstack-System-Scope: None Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: User-Agent: python-novaclient Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Auth-Token: gAAAAABi18WHatKWo2YDGuHCRg-Hr4BU9ih4y20k27gEn53g5fFq7moYh8PD2wy4i3mEySYEpYzPHO1ETV_ySF3O_tcrI0GemDmouOR_kQd3rt7C6vd_p15X9by3suO0TVjteV2sEGvvBR-qUmw6dUd8NpCxGi8Ul4qqSy3YGdKBAzFu10GZ8y4 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Domain-Id: None Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Domain-Name: None Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Identity-Status: Confirmed Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Is-Admin-Project: True Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Domain-Id: default Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Domain-Name: Default Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Name: admin Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Role: reader,admin,member Jul 20 09:06:16.529263 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Roles: reader,admin,member Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant: admin Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant-Name: admin Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User: admin Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Domain-Id: default Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Domain-Name: Default Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Id: d01511dd98c7416fb8387a8557165556 Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Name: admin Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: method: > Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: exception: Flavor 84 could not be found. Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: action_args: {'id': '84'} Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:06:16.530619 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:16.531484 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.532683 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-e8636b17-98c5-469e-8336-abf156d27dbe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:06:16.533779 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-e8636b17-98c5-469e-8336-abf156d27dbe admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387392 Jul 20 09:06:16.533779 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jul 20 09:06:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:16.540581 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1b1d98fe-535b-4e4a-b06e-c5aa408de12d admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:16.555287 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1b1d98fe-535b-4e4a-b06e-c5aa408de12d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018395 Jul 20 09:06:16.555849 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jul 20 09:06:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:06:16.566177 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-cfb3d973-37df-4bdc-95e6-bfe63008f666 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:16.580095 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-cfb3d973-37df-4bdc-95e6-bfe63008f666 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018107 Jul 20 09:06:16.580609 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jul 20 09:06:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:06:16.589725 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-f5110f5c-cdaf-4371-92f6-74bba06a7d59 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:16.595083 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.wsgi [None req-f5110f5c-cdaf-4371-92f6-74bba06a7d59 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-f5110f5c-cdaf-4371-92f6-74bba06a7d59 admin admin] Request method failure captured: Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Accept: application/json Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Accept-Encoding: gzip, deflate Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Connection: keep-alive Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Content-Length: 0 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Host: 10.222.0.44 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Openstack-Api-Version: compute 2.90 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Openstack-System-Scope: None Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: User-Agent: python-novaclient Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Auth-Token: gAAAAABi18WHatKWo2YDGuHCRg-Hr4BU9ih4y20k27gEn53g5fFq7moYh8PD2wy4i3mEySYEpYzPHO1ETV_ySF3O_tcrI0GemDmouOR_kQd3rt7C6vd_p15X9by3suO0TVjteV2sEGvvBR-qUmw6dUd8NpCxGi8Ul4qqSy3YGdKBAzFu10GZ8y4 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Domain-Id: None Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Domain-Name: None Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Identity-Status: Confirmed Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Is-Admin-Project: True Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Domain-Id: default Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Domain-Name: Default Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Name: admin Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Role: reader,admin,member Jul 20 09:06:16.596599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Roles: reader,admin,member Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant: admin Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant-Name: admin Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User: admin Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Domain-Id: default Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Domain-Name: Default Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Id: d01511dd98c7416fb8387a8557165556 Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Name: admin Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: method: > Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: exception: Flavor 84 could not be found. Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: action_args: {'id': '84'} Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:06:16.598120 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:16.598934 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:16.600246 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-f5110f5c-cdaf-4371-92f6-74bba06a7d59 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:06:16.601475 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-f5110f5c-cdaf-4371-92f6-74bba06a7d59 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011948 Jul 20 09:06:16.601475 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Jul 20 09:06:16 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 09:06:17.573632 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-cfb3d973-37df-4bdc-95e6-bfe63008f666 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:17.574632 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-cfb3d973-37df-4bdc-95e6-bfe63008f666 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Jul 20 09:06:17.575052 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:18.112743 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-06e080d6-31fe-4ac1-bcb0-e0186dd77e04 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:18.118599 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.wsgi [None req-06e080d6-31fe-4ac1-bcb0-e0186dd77e04 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-06e080d6-31fe-4ac1-bcb0-e0186dd77e04 admin admin] Request method failure captured: Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Accept: application/json Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Accept-Encoding: gzip, deflate Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Connection: keep-alive Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Content-Length: 0 Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Host: 10.222.0.44 Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Openstack-Api-Version: compute 2.90 Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Openstack-System-Scope: None Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: User-Agent: python-novaclient Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Auth-Token: gAAAAABi18WJZ2HnX2tP0ckTqs53r9x4_mS7pd3_MiivuPjYfP63XDokhUNGNkHVwB0sBs77wq5ANjacYBXBDpcQS5UQXqJW0tOdBDzBPiLo2eIy7PzLTxIqlzvn4t7oLEX6-CLpxMt1mlE4PAIxZM8G2Gd0NvL6pU_exbnw63ywowmsEjhL5nY Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Domain-Id: None Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Domain-Name: None Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Identity-Status: Confirmed Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Is-Admin-Project: True Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Domain-Id: default Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Domain-Name: Default Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Project-Name: admin Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Role: reader,admin,member Jul 20 09:06:18.120137 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Roles: reader,admin,member Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant: admin Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-Tenant-Name: admin Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User: admin Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Domain-Id: default Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Domain-Name: Default Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Id: d01511dd98c7416fb8387a8557165556 Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: X-User-Name: admin Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: method: > Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: exception: Flavor 451 could not be found. Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: action_args: {'id': '451'} Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:06:18.121571 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:18.122627 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.124136 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-06e080d6-31fe-4ac1-bcb0-e0186dd77e04 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103318) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:06:18.125400 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-06e080d6-31fe-4ac1-bcb0-e0186dd77e04 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.408810 Jul 20 09:06:18.125400 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jul 20 09:06:17 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 20 09:06:18.131899 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-f13bd051-9c3d-49b4-8b06-2f21a82beef7 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:18.145685 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-f13bd051-9c3d-49b4-8b06-2f21a82beef7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018213 Jul 20 09:06:18.146204 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jul 20 09:06:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:06:18.155306 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:18.169915 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018082 Jul 20 09:06:18.170431 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Jul 20 09:06:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:06:18.180029 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-258111d1-45ba-46cb-8f64-60b8d3bdf92f admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:18.185412 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.wsgi [None req-258111d1-45ba-46cb-8f64-60b8d3bdf92f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-258111d1-45ba-46cb-8f64-60b8d3bdf92f admin admin] Request method failure captured: Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Accept: application/json Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Accept-Encoding: gzip, deflate Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Connection: keep-alive Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Content-Length: 0 Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Host: 10.222.0.44 Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Openstack-Api-Version: compute 2.90 Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Openstack-System-Scope: None Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: User-Agent: python-novaclient Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Auth-Token: gAAAAABi18WJZ2HnX2tP0ckTqs53r9x4_mS7pd3_MiivuPjYfP63XDokhUNGNkHVwB0sBs77wq5ANjacYBXBDpcQS5UQXqJW0tOdBDzBPiLo2eIy7PzLTxIqlzvn4t7oLEX6-CLpxMt1mlE4PAIxZM8G2Gd0NvL6pU_exbnw63ywowmsEjhL5nY Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Domain-Id: None Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Domain-Name: None Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Identity-Status: Confirmed Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Is-Admin-Project: True Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Openstack-Nova-Api-Version: 2.90 Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Domain-Id: default Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Domain-Name: Default Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Project-Name: admin Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Role: reader,admin,member Jul 20 09:06:18.186925 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Roles: reader,admin,member Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d5e32bdaa14a4d31baa44b436b02a242"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant: admin Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant-Id: d5e32bdaa14a4d31baa44b436b02a242 Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-Tenant-Name: admin Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User: admin Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Domain-Id: default Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Domain-Name: Default Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Id: d01511dd98c7416fb8387a8557165556 Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: X-User-Name: admin Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: method: > Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: exception: Flavor 451 could not be found. Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: action_args: {'id': '451'} Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:06:18.188457 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:18.189547 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: ERROR nova.api.openstack.wsgi Jul 20 09:06:18.190981 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-258111d1-45ba-46cb-8f64-60b8d3bdf92f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103317) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:06:18.192267 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-258111d1-45ba-46cb-8f64-60b8d3bdf92f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011743 Jul 20 09:06:18.192267 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jul 20 09:06:18 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 20 09:06:19.166648 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:19.167678 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 20 09:06:19.168074 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:19.698999 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-fb9c2b78-91be-48eb-9ca1-6eda3abe4f36 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:06:19.717035 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-fb9c2b78-91be-48eb-9ca1-6eda3abe4f36 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.408402 Jul 20 09:06:19.717570 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jul 20 09:06:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:06:20.679923 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:20.680922 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 20 09:06:20.681311 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:21.202118 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-0c5c44f3-67a2-4712-bff8-9f86e3d6d78c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:06:21.218414 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-0c5c44f3-67a2-4712-bff8-9f86e3d6d78c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400462 Jul 20 09:06:21.218999 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jul 20 09:06:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:06:22.192558 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:22.193546 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jul 20 09:06:22.193941 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:22.717019 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-104c8105-50a3-44da-b10d-2c5248be8a9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:06:22.734775 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-104c8105-50a3-44da-b10d-2c5248be8a9d admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.400238 Jul 20 09:06:22.735322 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jul 20 09:06:22 2022] POST /compute/v2.1/flavors => generated 407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:06:23.709860 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:23.710894 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 20 09:06:23.711290 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:24.230312 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-93cdf936-e8c9-488a-9f1f-7ccab59ed173 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:06:24.248927 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-93cdf936-e8c9-488a-9f1f-7ccab59ed173 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.400796 Jul 20 09:06:24.249464 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Jul 20 09:06:23 2022] POST /compute/v2.1/flavors => generated 409 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:06:25.213543 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:25.214547 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 20 09:06:25.214978 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:06:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:06:25.744149 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-14f528d5-bc7e-41f4-9a01-6e16ce70aa10 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:06:25.763358 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-14f528d5-bc7e-41f4-9a01-6e16ce70aa10 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.406389 Jul 20 09:06:25.763883 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Wed Jul 20 09:06:25 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:07:17.912902 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:07:17.913915 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-eb32434e-a79f-4a8c-a841-712667782c74 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 20 09:07:17.914304 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 930 bytes} [Wed Jul 20 09:07:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:07:17.924560 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:18.315909 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-fcddb63d-ef91-4c23-8967-3ba01c395f15 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:07:18.336119 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-fcddb63d-ef91-4c23-8967-3ba01c395f15 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415855 Jul 20 09:07:18.336913 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1291 bytes} [Wed Jul 20 09:07:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:07:18.358415 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG dbcounter [-] [103318] Writing DB stats nova_api:SELECT=14 {{(pid=103318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:07:18.363347 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-cd869c16-c910-4848-8593-898d97db4af5 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:07:18.371073 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-cd869c16-c910-4848-8593-898d97db4af5 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014055 Jul 20 09:07:18.371590 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1282 bytes} [Wed Jul 20 09:07:18 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:07:18.383470 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-d303b4e1-92a8-4950-aa11-c5c9e0f49277 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:07:18.391076 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-d303b4e1-92a8-4950-aa11-c5c9e0f49277 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011431 Jul 20 09:07:18.392073 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1285 bytes} [Wed Jul 20 09:07:18 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:07:18.402751 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:07:18.410752 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011466 Jul 20 09:07:18.411265 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1285 bytes} [Wed Jul 20 09:07:18 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:07:18.422069 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-8cdf0385-7eba-48ec-bcf1-091eae4328ed admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:07:18.430055 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-8cdf0385-7eba-48ec-bcf1-091eae4328ed admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011451 Jul 20 09:07:18.430553 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1282 bytes} [Wed Jul 20 09:07:18 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:10:36.238551 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:36.239575 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 20 09:10:36.239973 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:10:36.384837 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_api:SELECT=6 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:10:36.542372 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-06c24209-be5e-441e-b5ed-4353f3e64c94 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:36.543559 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:10:36.543559 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: warnings.warn(msg) Jul 20 09:10:36.544771 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-06c24209-be5e-441e-b5ed-4353f3e64c94 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:36.545747 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-06c24209-be5e-441e-b5ed-4353f3e64c94 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:36.546526 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-06c24209-be5e-441e-b5ed-4353f3e64c94 admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:36.546955 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-06c24209-be5e-441e-b5ed-4353f3e64c94 admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:36.580946 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-06c24209-be5e-441e-b5ed-4353f3e64c94 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.197498 Jul 20 09:10:36.581505 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jul 20 09:10:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:10:37.417916 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:37.419039 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 20 09:10:37.419561 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:10:37.614640 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-6a3149f2-0585-4a1c-a125-231d307cb6f8 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:37.615856 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:10:37.615856 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: warnings.warn(msg) Jul 20 09:10:37.617034 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-6a3149f2-0585-4a1c-a125-231d307cb6f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:37.617462 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-6a3149f2-0585-4a1c-a125-231d307cb6f8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:37.618326 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-6a3149f2-0585-4a1c-a125-231d307cb6f8 admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:37.618695 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-6a3149f2-0585-4a1c-a125-231d307cb6f8 admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:37.638112 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-6a3149f2-0585-4a1c-a125-231d307cb6f8 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076047 Jul 20 09:10:37.639201 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jul 20 09:10:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:10:48.887767 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:48.889366 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Jul 20 09:10:48.889757 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:10:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:10:49.034881 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_cell0:SELECT=4 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:10:49.035588 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_cell1:SELECT=4 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:10:49.036229 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG dbcounter [-] [103317] Writing DB stats nova_api:SELECT=8 {{(pid=103317) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:10:49.084437 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-9c6d66ba-23a3-457a-a44f-5aa9b351ccb5 admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:49.085593 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:10:49.085593 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: warnings.warn(msg) Jul 20 09:10:49.086777 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-9c6d66ba-23a3-457a-a44f-5aa9b351ccb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:49.087207 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-9c6d66ba-23a3-457a-a44f-5aa9b351ccb5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:49.087968 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-9c6d66ba-23a3-457a-a44f-5aa9b351ccb5 admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:49.088384 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-9c6d66ba-23a3-457a-a44f-5aa9b351ccb5 admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:49.112566 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-9c6d66ba-23a3-457a-a44f-5aa9b351ccb5 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082141 Jul 20 09:10:49.113096 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jul 20 09:10:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:10:49.936265 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: DEBUG nova.api.openstack.wsgi [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] Calling method '>' {{(pid=103318) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:49.937296 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: INFO nova.api.openstack.requestlog [None req-1572fd49-2d8b-4c00-9bf3-48327b3b7938 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 20 09:10:49.937708 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: [pid: 103318|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Jul 20 09:10:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:10:50.128492 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG nova.api.openstack.wsgi [None req-69e75d22-0a9d-465c-bb20-1ac7ebf3e79d admin admin] Calling method '>' {{(pid=103317) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:10:50.129650 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 09:10:50.129650 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: warnings.warn(msg) Jul 20 09:10:50.130846 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-69e75d22-0a9d-465c-bb20-1ac7ebf3e79d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:50.131279 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-69e75d22-0a9d-465c-bb20-1ac7ebf3e79d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:50.132073 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-69e75d22-0a9d-465c-bb20-1ac7ebf3e79d admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:10:50.132489 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: DEBUG oslo_concurrency.lockutils [None req-69e75d22-0a9d-465c-bb20-1ac7ebf3e79d admin admin] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103317) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:10:50.153919 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: INFO nova.api.openstack.requestlog [None req-69e75d22-0a9d-465c-bb20-1ac7ebf3e79d admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077107 Jul 20 09:10:50.154411 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: [pid: 103317|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Jul 20 09:10:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:11:47.744943 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: Wed Jul 20 09:11:47 2022 - graceful shutdown triggered... Jul 20 09:11:47.745437 dv-cinder-843309-5-iscsi devstack@n-api.service[103318]: Gracefully killing worker 2 (pid: 103318)... Jul 20 09:11:47.745796 dv-cinder-843309-5-iscsi devstack@n-api.service[103317]: Gracefully killing worker 1 (pid: 103317)... Jul 20 09:11:47.747587 dv-cinder-843309-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 20 09:11:48.746100 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: worker 1 buried after 1 seconds Jul 20 09:11:48.746617 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: worker 2 buried after 1 seconds Jul 20 09:11:48.746617 dv-cinder-843309-5-iscsi devstack@n-api.service[103316]: goodbye to uWSGI. Jul 20 09:11:48.747811 dv-cinder-843309-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 20 09:11:48.748363 dv-cinder-843309-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 20 09:11:48.751117 dv-cinder-843309-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 20 09:11:48.762255 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 09:11:48 2022] *** Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: nodename: dv-cinder-843309-5-iscsi Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: machine: x86_64 Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: clock source: unix Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: pcre jit disabled Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: detected number of CPU cores: 4 Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: current working directory: / Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: detected binary path: /usr/bin/uwsgi-core Jul 20 09:11:48.765009 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: your processes number limit is 47680 Jul 20 09:11:48.765883 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: your memory page size is 4096 bytes Jul 20 09:11:48.765883 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: detected max file descriptor number: 2048 Jul 20 09:11:48.765883 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: lock engine: pthread robust mutexes Jul 20 09:11:48.765883 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: thunder lock: enabled Jul 20 09:11:48.765883 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 20 09:11:48.765883 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 09:11:48.811868 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: Python main interpreter initialized at 0x5604c21209c0 Jul 20 09:11:48.811868 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: python threads support enabled Jul 20 09:11:48.811868 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: your server socket listen backlog is limited to 100 connections Jul 20 09:11:48.811868 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: your mercy for graceful operations on workers is 90 seconds Jul 20 09:11:48.812331 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 09:11:48.812331 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: *** Operational MODE: preforking *** Jul 20 09:11:48.812527 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: *** uWSGI is running in multiple interpreter mode *** Jul 20 09:11:48.812527 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: spawned uWSGI master process (pid: 117849) Jul 20 09:11:48.812730 dv-cinder-843309-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 20 09:11:48.814460 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: spawned uWSGI worker 1 (pid: 117871, cores: 1) Jul 20 09:11:48.819279 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: spawned uWSGI worker 2 (pid: 117872, cores: 1) Jul 20 09:11:48.819517 dv-cinder-843309-5-iscsi devstack@n-api.service[117849]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 09:11:49.483357 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:11:49.484492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 20 09:11:50.686672 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:11:50.686672 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: from cryptography.utils import int_from_bytes Jul 20 09:11:50.687300 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:11:50.687300 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: from cryptography.utils import int_from_bytes Jul 20 09:11:50.691574 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:11:50.691574 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: from cryptography.utils import int_from_bytes Jul 20 09:11:50.692020 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 09:11:50.692020 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: from cryptography.utils import int_from_bytes Jul 20 09:11:53.051492 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:11:53.052017 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:11:53.052313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:11:53.052694 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:11:53.052956 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:11:53.053352 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.053689 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.054020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.054347 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.054852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.055051 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.055381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.055711 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.056048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.056313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.056634 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.056967 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-5-iscsi {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.057298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.057614 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.057935 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.058395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.058849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.059189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.059508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.060016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.060754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.061074 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.061399 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.061747 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.062070 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.062388 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.062760 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.063081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.063414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.063733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.064141 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-5-iscsi {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.064470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.064791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.065115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.065539 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.065859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.066177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.066504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.066875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.067194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.067529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.067856 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.068184 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.068510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.068822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.069138 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.069454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.069779 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.070091 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.070404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.070660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.071000 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.071328 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.071663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.071993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.072253 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.072511 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.073102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.073429 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.073757 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.074589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.074925 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.075241 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.075555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.075868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.076183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.076497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.076822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.077144 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.077473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.077789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.078113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.078520 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.078807 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.079126 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.079473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.079802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.080187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.080440 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.080768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.081086 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.081400 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.081720 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.082047 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.082388 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.082721 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.082984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.083296 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.083611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.083942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.084250 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.084566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.084880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.085188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.085501 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.085817 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.086129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.086453 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.086778 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.087093 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.087405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.087718 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.088031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.088355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.088681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.088994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.089305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.090306 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.090634 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.090996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.091333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.091640 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.091971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.092288 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.092604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.092931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.093038 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 09:11:53.093445 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.093542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 09:11:53.093635 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.093819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 09:11:53.093920 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.094158 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.094261 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 09:11:53.094441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 09:11:53.094533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.094810 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.094920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.095129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.095231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.095443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.095543 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.095758 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.095898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.096072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.096169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.096388 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.096521 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.096696 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.096848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.097007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.097178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.097428 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.097601 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.097872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.097974 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.098197 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.098530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-843309-5-iscsi {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.098621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.098889 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.099208 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.099311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.099527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.099803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.099895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.100148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.100403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.100503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.100775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.101014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.101287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.101604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.101712 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.101916 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.102232 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.102323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.102914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.103114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.103450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.103582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.103778 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.104108 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.104267 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.104426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.104757 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.104854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.105076 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.105473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.105722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-843309-5-iscsi {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.106109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.106249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.106461 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.106742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.106854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.107231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.107411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.107578 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.107742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.107851 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.108149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.108254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.108488 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.108589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.108805 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.108905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.109144 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.109303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.109492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.109605 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.109819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.109915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.110145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.110240 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.110529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.110630 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.110905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.111058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.111238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.111360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.111622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.111761 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.111911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.112041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.112219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.112337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.112478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.112604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.112792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.112927 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.113120 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.113251 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.113445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.113564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.113777 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.113909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.114042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.114197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.114316 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.114524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.114653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.115895 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.116071 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.116239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.116387 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.116542 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.116704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.116704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.116987 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.117132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.117236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.117344 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.117486 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.117584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.117671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.117763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.117848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.117947 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.118033 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.118125 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.118210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.118300 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.118393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.118494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.118588 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.118691 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.118795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.118999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.119408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.119667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.119916 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.120007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.120258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.120373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.120598 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.120723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.121107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.121199 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.121552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.121746 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.121981 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.122095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.122181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.122419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.122538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.122756 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.122868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.123068 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.123175 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.123396 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.123493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.123742 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.123850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.124056 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.124159 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.124311 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.124406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.124618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.124724 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.124931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.125034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.125255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.125350 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.125568 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.125664 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.125881 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.125976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.126208 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.126320 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.126503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.126610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.126839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.126953 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.127153 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.127262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.127470 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.127578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.127784 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.127892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.128095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.128208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.128405 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.128519 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.128723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.128830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.129034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.129188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.129343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.129449 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.129664 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.129759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.129986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.130098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.130293 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.130397 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.130603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.130718 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.130938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.131046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.131251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.131347 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.131574 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.131681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.131885 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.132004 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.132195 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.132290 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.132520 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.132630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.132833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.132936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.133188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.133280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.133513 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.133619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.133827 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.133929 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.134145 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.134239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.134458 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.134564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.134798 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.134909 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.135114 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.135223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.135437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.135543 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.135747 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.135843 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.136057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.136151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.136941 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.137105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.137262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.137509 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.137658 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.137868 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.138019 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.138190 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.138291 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.138502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.138595 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.138853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.139053 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.139236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.139377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.139509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.139613 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.139795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.139891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.140119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.140211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.140434 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.140535 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.140748 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.140843 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.141073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 09:11:53.141175 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.141416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.141522 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.141742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.141879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.142063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.142165 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.142382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.142474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.142730 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.142827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.143055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.143147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.143381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.143487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.143698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.143798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144024 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144755 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.144980 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.145079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.145300 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.145407 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.145613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.145775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.145936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.146152 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.146292 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.146490 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.146617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.146852 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.146992 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.147237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.147393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.147538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.147667 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.147858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.147978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.148182 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.148311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.148508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.148626 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.148828 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.148954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.149145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.149282 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.149471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.149600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.149790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.149918 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.150116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.150244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.150434 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.150561 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.150787 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.150907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.151110 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.151231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.151427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.151554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.151737 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.151861 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.152697 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.152840 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.152962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.153447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.153684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.153830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.153940 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.154103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.154197 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.154435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.154536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.154785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.154934 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.155106 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.155202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.155428 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.155529 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.155743 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.155847 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.156060 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.156154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.156380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.156547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.156732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.156912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.157040 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.157239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.157336 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.157595 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.157699 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.157916 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.158011 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.158236 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.158329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.158554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.158658 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.158896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.159260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.159363 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.159868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160437 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160630 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160782 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.160916 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.161097 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.161252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.161426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.161615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.161742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.161991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.162095 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.162308 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.162401 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.162644 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.162805 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.163020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.163334 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.163645 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.163822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.163961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.164158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.164265 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.164562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.164672 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.164886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165021 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165205 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165334 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165522 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.165944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.166167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.166259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.166482 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.166573 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.166823 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.166932 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.167140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.167241 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.167457 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.167550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.168324 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.168425 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.168786 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169346 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.169995 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.170097 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.170314 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.170408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.170634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.170768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.170985 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.171274 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.171382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.171619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.171717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.171946 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.172046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.172273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.172379 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.172607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.172728 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.172931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.173049 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.173248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.173366 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.173559 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.173708 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.173935 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.174249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.174368 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.174566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.174719 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.174944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.175499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.175649 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.175765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.175877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.175988 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176111 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176358 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176498 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.176915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177047 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177766 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.177933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.178066 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.178246 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.178385 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.178567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.178739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.178909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.179056 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.179229 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.179418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.179650 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.179835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.179971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180109 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180379 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180522 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180800 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.180938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.181069 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.181205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.181396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.181532 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.181710 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.181829 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.182060 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.182226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.182394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.182768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.183087 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.183502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.183675 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.183832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.184139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.184299 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.184495 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.184654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.184826 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.184990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.185143 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.185286 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.185437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.185607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.185859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.186034 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.186188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.186341 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.186493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.186638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.186930 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.187091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.187238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.187383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.187607 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.187919 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.188151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.188312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.188492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.188652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.188834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.188985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.189150 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.189316 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.189477 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.189632 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.189785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.189938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.190098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.190251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.190414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.190568 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.190785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.190937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.191096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.191249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.191409 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.191557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.191708 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.191868 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.192013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.192260 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.192415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.192583 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.192730 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.192883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193638 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.193987 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194131 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194283 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.194923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.195205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.195350 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.195525 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.195679 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.195850 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.196104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.196263 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.196416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.196571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.196739 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.196886 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.197037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.197181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.197376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.197529 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.197909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.198022 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.198116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.198286 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.198380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.198481 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.198598 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.199337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.199880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.200177 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.200473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.200631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.200801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.200959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.201112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.201429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.201619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.201771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.201959 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.202131 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.202285 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.202438 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.204110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.204294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.204447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.204594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.204766 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.204921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.205100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.205248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.205416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.205560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.205719 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.205864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206180 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206363 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206849 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.206987 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.207146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.207293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.207451 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.207604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.207748 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.207891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208492 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.208922 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209070 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209235 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209543 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209687 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209837 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.209978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.210123 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.210280 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.210433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.210578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.210748 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.210898 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.211125 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.211270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.211423 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.211572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.211712 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.211869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212158 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212300 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.212874 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213015 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213155 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213607 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.213896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.214045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.214183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.214183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.214481 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.215225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.215423 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.215568 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.215717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.215869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.215996 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216297 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216686 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216825 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.216933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.217102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.217243 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.217400 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.217400 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.217657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.217804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.218011 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.218329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.218656 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219021 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219212 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.219984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.220197 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.220371 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.220505 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.220823 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.220977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.221147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.221300 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.221723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.221815 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222107 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222290 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222528 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.222891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.223181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.223181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.223463 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.223617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.223757 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.223925 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224211 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224370 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.224942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.225085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.225239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.225895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.226082 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.226238 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.226505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.226726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.227973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.228162 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.228323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.228504 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.228649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.228802 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.228955 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.229098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.229247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.229582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.229741 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.229880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.229993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.230147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.230359 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.230526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.230732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.230896 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.231213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.231370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.231523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.231709 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.231895 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232340 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232637 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.232935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.233084 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.233234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.233393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.233544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.233731 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.233878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234019 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234161 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.234968 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.235119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.235261 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.235417 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.235676 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.236298 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.236456 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.236616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.236761 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.236912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.237074 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.237216 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.237412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.237795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.238416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.238580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.238754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.238911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.239054 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.239196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.239338 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.239510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.239752 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.239907 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240370 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240842 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.240983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.241124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.241364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.241520 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.241671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.241835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.242133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.242318 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.243044 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.243201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.243344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.243495 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.243638 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.243780 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244189 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244485 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244637 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244823 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.244972 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.245114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.245295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.245441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.245590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.245854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.246003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.246187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.246187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.246500 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.246652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.246842 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.247026 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.247170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.247311 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.247451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.247592 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.247961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.248315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.248494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.248649 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.248791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.248942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.249201 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.249348 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.249497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.249648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.249896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.250053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.250232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.250378 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.250559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.250728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.250887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251071 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251224 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251224 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251512 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251668 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251821 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.251976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.252118 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.252258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.252407 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.252589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.252745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.252897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253195 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.253959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.254099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.254281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.254443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.254594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.254820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.254965 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.255136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.255352 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.255514 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.255666 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.255834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256047 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256633 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256773 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.256913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.257060 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.257216 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.257359 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.257516 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.257667 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.257826 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.258662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.258874 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.259027 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.259202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.259371 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.259539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.259789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.260033 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.260180 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.260791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.260954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.261099 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.261256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.261994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.262844 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263018 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263165 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263356 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263356 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.263935 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264536 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264677 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264825 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.264969 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265119 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265269 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265680 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265819 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.265987 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.266226 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.266375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.266524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.266524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.266826 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267161 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.267909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.268278 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.268653 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.268917 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.269088 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.269088 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.269459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.269602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.269762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.270001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.270258 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.270415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.270578 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.270762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.270952 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.271109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.271299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.271445 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.271596 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.271745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.271886 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272774 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.272915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273220 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273363 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273513 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.273947 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.274088 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.274229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.274388 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.274531 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.274742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.274902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.275478 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.275640 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.275784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.275933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.276086 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.276246 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.276468 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.276625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.276768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.276921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.277167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.277316 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.277459 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.277601 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.277759 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.277985 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.278161 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.278743 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.278934 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.279110 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.279256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.279453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.279602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.279753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.279903 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.280045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.280187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.280441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.280702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.280858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281292 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281448 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281609 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281761 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.281903 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282633 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.282962 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.283115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.283266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.283416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.283571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.283713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.283864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284166 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284308 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284598 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284598 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.284889 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285469 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.285911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.286058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.286206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.286347 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.286588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.286753 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.286931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.287076 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.287266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.287460 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.287622 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.287765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.287915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.288057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.288206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.288574 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.288936 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289087 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289370 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289511 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289661 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.289962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.290114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.290256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.290396 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.290733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.290979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.291129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.291270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.291423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.291566 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.291716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.291866 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.292018 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.292168 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.292317 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.292467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.293170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.293352 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.293499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.293652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.293794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.293959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.294103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.294245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.294386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.294538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.294707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.294867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295011 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295152 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295521 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.295960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.296101 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.296248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.296411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.296572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.296795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.296949 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297389 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297540 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297682 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297682 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.297949 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.298105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.298249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.298432 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299195 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299759 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.299901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.300042 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.300183 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.300323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.301393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.301621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.301787 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.301932 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.302074 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.302223 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.302223 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.302515 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.302658 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.302837 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303012 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303166 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.303938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304523 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.304970 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.305124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.305267 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.305408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.305565 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.305716 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.305868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.306018 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.306160 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.306300 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.306440 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.306588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.306773 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307146 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307587 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.307891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.308040 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.308216 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.308405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.308562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.309162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.309162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.309448 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.309600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.309745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.309912 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310205 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310632 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.310961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.311102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.311383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.311656 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.311820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.311987 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312132 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312711 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.312996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.313145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.313287 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.313428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.313579 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.313730 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.313889 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314032 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.314957 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.315099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.315251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.315397 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.315556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.315698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.315849 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.316890 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317129 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317276 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317276 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.317976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.318127 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.318267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.318416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.318557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.318732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.319381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.319533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.319674 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.319827 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.319990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320701 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320851 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.320994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.321134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.321284 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.322138 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.322304 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.323067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.323231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.323375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.323517 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.323660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.323660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.324550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.324550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.325462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.325628 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.325780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.325780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.326088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.326260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.326418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.326567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.326751 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.326926 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.327076 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.327320 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.327483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.327665 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.327831 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.327831 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.328822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.329457 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.329632 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.329792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.329951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.330117 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.330281 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.330431 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.330588 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.330759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.330931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.331091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.331248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.331405 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.331572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.331572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.331872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.332041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.332574 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.332743 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.332902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.333061 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.333224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.333381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.333547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.333713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.333863 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.334040 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.334200 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.334358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.334507 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.334663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.334855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.335090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.335244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.335477 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.335639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.335789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.335944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.336869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.337162 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.337644 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.337806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.337964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.337964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.338303 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.338661 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.339006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.339181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.341669 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.341870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.342025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.342176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.342326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.345834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.346091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.346279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.346439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.346621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.346829 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.346991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.347155 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.347315 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.347476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.347476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348182 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348343 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348824 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.348989 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117872) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.349913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.351726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.353081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.354791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.356343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.357483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.358888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.360282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.361883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.363888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.365013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.366439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.367668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.369707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.372040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.373147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.374665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.374665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.374665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.374665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.375256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.375256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.375565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.375911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.376068 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.376384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.376701 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 09:11:53.376937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117871) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 09:11:53.487825 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO dbcounter [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Registered counter for database nova_api Jul 20 09:11:53.509108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_db.sqlalchemy.engines [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.516382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writer thread running {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.534524 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Registered counter for database nova_api Jul 20 09:11:53.554835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.562336 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.574596 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.context [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea(cell1) {{(pid=117872) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:11:53.578780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:11:53.580360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:11:53.581189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:11:53.583214 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:11:53.585187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO dbcounter [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Registered counter for database nova_cell0 Jul 20 09:11:53.589222 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO dbcounter [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Registered counter for database nova_cell1 Jul 20 09:11:53.596619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_db.sqlalchemy.engines [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.598443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_db.sqlalchemy.engines [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.604415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writer thread running {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.606105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writer thread running {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.619973 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.context [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea(cell1) {{(pid=117871) load_cells /opt/stack/nova/nova/context.py:464}} Jul 20 09:11:53.625102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:11:53.626704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:11:53.627531 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:11:53.629518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:11:53.631498 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Registered counter for database nova_cell0 Jul 20 09:11:53.635580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Registered counter for database nova_cell1 Jul 20 09:11:53.643114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.644870 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.650846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.653931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.752248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO dbcounter [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Registered counter for database nova_cell0 Jul 20 09:11:53.759074 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_db.sqlalchemy.engines [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117872) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.763935 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writer thread running {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:53.802080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO dbcounter [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Registered counter for database nova_cell0 Jul 20 09:11:53.808875 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_db.sqlalchemy.engines [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117871) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 09:11:53.813289 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writer thread running {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 09:11:54.082262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: WARNING keystonemiddleware.auth_token [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:11:54.089688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: WARNING keystonemiddleware.auth_token [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:11:54.141242 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:11:54.148595 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:11:54.436325 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: WARNING keystonemiddleware.auth_token [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:11:54.442546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: WARNING keystonemiddleware.auth_token [None req-68f067b2-69aa-42da-98e0-66f7603aac07 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:11:54.449923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604c21209c0 pid: 117872 (default app) Jul 20 09:11:54.504030 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 20 09:11:54.510091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: WARNING keystonemiddleware.auth_token [None req-c92aac32-95d7-4969-980d-8a0cb3c759da None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 20 09:11:54.516788 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5604c21209c0 pid: 117871 (default app) Jul 20 09:12:34.887049 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:34.888247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:34.889614 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:34.890346 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:35.803369 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:35.804110 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:35.805353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:35.806541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:12:35.881591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-66405617-701a-4a33-96dd-2dafc51d614a tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Action: 'create', calling method: .version_select at 0x7fadbdb56c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1623529157", "metadata": {"Type": "work"}}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:37.231252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-42a19629-8bfb-4acf-bf8a-85d1985e6678 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Action: 'create', calling method: .version_select at 0x7fadbdb56c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-732883831", "metadata": {"Type": "work"}}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-42a19629-8bfb-4acf-bf8a-85d1985e6678 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Request method failure captured: Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 121 Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cD8lAZ67UZQ8ZNvywqkHAxa6sO4_H8VYk4B4htNJGbCLUkWljJFPkvbJESle45r9fm6FzRqUVg6kAFj2QUVxhrG0GRfQhneLUtmuF8ajaky7nnVTbMX9aUzGcLQSmYasVslh6Bzu3BaoQEiyjK_z4G-DSb9o_huMq5QDDkPGk1g3M Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:37.257514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50baf84541494e7596c3d73a3214cb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: fc65968e84a8402ea0abee1f1749700c Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-732883831", "metadata": {"Type": "work"}}} Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:37.259004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-732883831', 'metadata': {'Type': 'work'}}}} Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise error Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi '#$%' Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:37.259819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 09:12:37.261725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 09:12:37.263025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 20 09:12:37.263025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.263025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-42a19629-8bfb-4acf-bf8a-85d1985e6678 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:37.263025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-42a19629-8bfb-4acf-bf8a-85d1985e6678 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.462852 Jul 20 09:12:37.263025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jul 20 09:12:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1466 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 09:12:37.272710 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-82d399a4-05a0-400d-b4bf-374465c4fab5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Action: 'create', calling method: .version_select at 0x7fadbdb77ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1374850212", "metadata": {"Type": "work"}}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-82d399a4-05a0-400d-b4bf-374465c4fab5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Request method failure captured: Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 120 Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cD8lAZ67UZQ8ZNvywqkHAxa6sO4_H8VYk4B4htNJGbCLUkWljJFPkvbJESle45r9fm6FzRqUVg6kAFj2QUVxhrG0GRfQhneLUtmuF8ajaky7nnVTbMX9aUzGcLQSmYasVslh6Bzu3BaoQEiyjK_z4G-DSb9o_huMq5QDDkPGk1g3M Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:37.278282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50baf84541494e7596c3d73a3214cb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: fc65968e84a8402ea0abee1f1749700c Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1374850212", "metadata": {"Type": "work"}}} Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:37.279897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1374850212', 'metadata': {'Type': 'work'}}}} Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise error Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi '0' Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:37.280661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 09:12:37.282095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 09:12:37.284474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 20 09:12:37.284474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.284474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-82d399a4-05a0-400d-b4bf-374465c4fab5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:37.284474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-82d399a4-05a0-400d-b4bf-374465c4fab5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014096 Jul 20 09:12:37.285023 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 2/2] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jul 20 09:12:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 20 09:12:37.300952 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e6af5745-5e1e-4a6e-b16b-8f76b0654cb5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Action: 'create', calling method: .version_select at 0x7fadbdb770d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-415545660", "metadata": {"Type": "work"}}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e6af5745-5e1e-4a6e-b16b-8f76b0654cb5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Request method failure captured: Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 118 Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cD8lAZ67UZQ8ZNvywqkHAxa6sO4_H8VYk4B4htNJGbCLUkWljJFPkvbJESle45r9fm6FzRqUVg6kAFj2QUVxhrG0GRfQhneLUtmuF8ajaky7nnVTbMX9aUzGcLQSmYasVslh6Bzu3BaoQEiyjK_z4G-DSb9o_huMq5QDDkPGk1g3M Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:37.308672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50baf84541494e7596c3d73a3214cb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: fc65968e84a8402ea0abee1f1749700c Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-415545660", "metadata": {"Type": "work"}}} Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:37.310410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-415545660', 'metadata': {'Type': 'work'}}}} Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise error Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi '' Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:37.311218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 20 09:12:37.312639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 20 09:12:37.313789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 20 09:12:37.313789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:37.313789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e6af5745-5e1e-4a6e-b16b-8f76b0654cb5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:37.313789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e6af5745-5e1e-4a6e-b16b-8f76b0654cb5 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.022968 Jul 20 09:12:37.316612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 3/3] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jul 20 09:12:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:12:37.332319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-065de3f8-1c31-488f-af46-8ad5652ca860 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Calling method '.version_select at 0x7fadbda87c10>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:38.107836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-66405617-701a-4a33-96dd-2dafc51d614a tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.243374 Jul 20 09:12:38.109566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 1/4] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Jul 20 09:12:34 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3247 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 20 09:12:38.123639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a9c75c46-6128-49f0-819f-c7c7598c39f6 tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Calling method '.version_select at 0x7fadbda20a60>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:38.143852 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-065de3f8-1c31-488f-af46-8ad5652ca860 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] HTTP exception thrown: Volume tempest-invalid-1017668763 could not be found. Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-065de3f8-1c31-488f-af46-8ad5652ca860 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Request method failure captured: Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1017668763 HTTP/1.1 Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cD8lAZ67UZQ8ZNvywqkHAxa6sO4_H8VYk4B4htNJGbCLUkWljJFPkvbJESle45r9fm6FzRqUVg6kAFj2QUVxhrG0GRfQhneLUtmuF8ajaky7nnVTbMX9aUzGcLQSmYasVslh6Bzu3BaoQEiyjK_z4G-DSb9o_huMq5QDDkPGk1g3M Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:38.148103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50baf84541494e7596c3d73a3214cb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: fc65968e84a8402ea0abee1f1749700c Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Volume tempest-invalid-1017668763 could not be found. Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'tempest-invalid-1017668763'} Jul 20 09:12:38.149718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1017668763 could not be found. (HTTP 404) (Request-ID: req-b3245b25-9dee-4465-a5ac-b8c737561dcf) Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.151271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:12:38.152904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1017668763 could not be found. Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:12:38.154429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1017668763 could not be found. Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1017668763 could not be found. Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-065de3f8-1c31-488f-af46-8ad5652ca860 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Returning 404 to user: Volume tempest-invalid-1017668763 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:38.158555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-065de3f8-1c31-488f-af46-8ad5652ca860 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1017668763" status: 404 len: 99 microversion: 2.1 time: 0.835111 Jul 20 09:12:38.161720 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 4/5] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jul 20 09:12:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1017668763 => generated 99 bytes in 838 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 20 09:12:38.177311 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-234a2dc8-6fc3-4d34-8c14-a8c9aefbbea4 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.011847 Jul 20 09:12:38.179046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 5/6] 10.222.0.44 () {58 vars in 1139 bytes} [Wed Jul 20 09:12:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 16 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 09:12:38.191283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-96838198-6909-4fc3-bd22-39e2f6075768 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006113 Jul 20 09:12:38.197215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 6/7] 10.222.0.44 () {58 vars in 1136 bytes} [Wed Jul 20 09:12:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 20 09:12:38.210864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b236e3b-ce05-4bc5-a70b-3dd6f72308d0 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Calling method '.version_select at 0x7fadbd9a5ee0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:38.248435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a9c75c46-6128-49f0-819f-c7c7598c39f6 tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d" status: 200 len: 353 microversion: 2.1 time: 0.130636 Jul 20 09:12:38.249308 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 2/8] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:38 2022] GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:12:38.323318 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ebc04809-4ac6-477a-be26-6a892d9ffd0c tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda20c10>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:38.388103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-6b236e3b-ce05-4bc5-a70b-3dd6f72308d0 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] HTTP exception thrown: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b236e3b-ce05-4bc5-a70b-3dd6f72308d0 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Request method failure captured: Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/os-volumes/8d79307a-fc9f-4e58-b214-1655cc73bb0b HTTP/1.1 Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cD8lAZ67UZQ8ZNvywqkHAxa6sO4_H8VYk4B4htNJGbCLUkWljJFPkvbJESle45r9fm6FzRqUVg6kAFj2QUVxhrG0GRfQhneLUtmuF8ajaky7nnVTbMX9aUzGcLQSmYasVslh6Bzu3BaoQEiyjK_z4G-DSb9o_huMq5QDDkPGk1g3M Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:38.391160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50baf84541494e7596c3d73a3214cb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: fc65968e84a8402ea0abee1f1749700c Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '8d79307a-fc9f-4e58-b214-1655cc73bb0b'} Jul 20 09:12:38.392795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. (HTTP 404) (Request-ID: req-79548ecf-dca0-42f4-bcec-5d7e0036dbb1) Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.393726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:12:38.394891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 09:12:38.395976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6b236e3b-ce05-4bc5-a70b-3dd6f72308d0 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Returning 404 to user: Volume 8d79307a-fc9f-4e58-b214-1655cc73bb0b could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6b236e3b-ce05-4bc5-a70b-3dd6f72308d0 tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/8d79307a-fc9f-4e58-b214-1655cc73bb0b" status: 404 len: 109 microversion: 2.1 time: 0.190334 Jul 20 09:12:38.397063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 7/9] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:12:38 2022] DELETE /compute/v2.1/os-volumes/8d79307a-fc9f-4e58-b214-1655cc73bb0b => generated 109 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:12:38.402796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-856daa34-9368-4adf-b5dc-4b970bdf547a tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Calling method '.version_select at 0x7fadbd9bc4c0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:38.444985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ebc04809-4ac6-477a-be26-6a892d9ffd0c tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/a32717ec-e84d-47ca-a114-057c706a3922" status: 200 len: 351 microversion: 2.1 time: 0.128097 Jul 20 09:12:38.445701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 3/10] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:38 2022] GET /compute/v2.1/os-volumes/a32717ec-e84d-47ca-a114-057c706a3922 => generated 351 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:12:38.475043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-856daa34-9368-4adf-b5dc-4b970bdf547a tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] HTTP exception thrown: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-856daa34-9368-4adf-b5dc-4b970bdf547a tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Request method failure captured: Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/os-volumes/949d72c3-aaa5-4c54-b396-2fc691f0d2f0 HTTP/1.1 Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cD8lAZ67UZQ8ZNvywqkHAxa6sO4_H8VYk4B4htNJGbCLUkWljJFPkvbJESle45r9fm6FzRqUVg6kAFj2QUVxhrG0GRfQhneLUtmuF8ajaky7nnVTbMX9aUzGcLQSmYasVslh6Bzu3BaoQEiyjK_z4G-DSb9o_huMq5QDDkPGk1g3M Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:38.477542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_50baf84541494e7596c3d73a3214cb95"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/50baf84541494e7596c3d73a3214cb95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 50baf84541494e7596c3d73a3214cb95 Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesNegativeTest-413822877 Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: fc65968e84a8402ea0abee1f1749700c Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesNegativeTest-413822877-project Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '949d72c3-aaa5-4c54-b396-2fc691f0d2f0'} Jul 20 09:12:38.479539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. (HTTP 404) (Request-ID: req-39e573ba-e860-4345-82cb-68ff25689f05) Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.481223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:12:38.483771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:12:38.487226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-856daa34-9368-4adf-b5dc-4b970bdf547a tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] Returning 404 to user: Volume 949d72c3-aaa5-4c54-b396-2fc691f0d2f0 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-856daa34-9368-4adf-b5dc-4b970bdf547a tempest-VolumesNegativeTest-413822877 tempest-VolumesNegativeTest-413822877-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/949d72c3-aaa5-4c54-b396-2fc691f0d2f0" status: 404 len: 109 microversion: 2.1 time: 0.080514 Jul 20 09:12:38.490754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 8/11] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:38 2022] GET /compute/v2.1/os-volumes/949d72c3-aaa5-4c54-b396-2fc691f0d2f0 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:12:39.261200 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-db3fb137-5cd6-4a4b-b8aa-417569be74ef tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Calling method '.version_select at 0x7fadbda39280>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:39.332136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-db3fb137-5cd6-4a4b-b8aa-417569be74ef tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d" status: 200 len: 354 microversion: 2.1 time: 0.075002 Jul 20 09:12:39.333004 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 4/12] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:39 2022] GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d => generated 354 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:39.346713 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3009cd26-af01-4993-bbcf-4a2daa66eb4d tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Calling method '.version_select at 0x7fadbd9a59d0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:39.411411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3009cd26-af01-4993-bbcf-4a2daa66eb4d tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d" status: 200 len: 354 microversion: 2.1 time: 0.070302 Jul 20 09:12:39.412989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 9/13] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:39 2022] GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:39.429839 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1ed3cc22-ffc2-4449-aa61-4688134f3ad1 tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Calling method '.version_select at 0x7fadbda39940>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:39.534741 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1ed3cc22-ffc2-4449-aa61-4688134f3ad1 tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d" status: 202 len: 0 microversion: 2.1 time: 0.108696 Jul 20 09:12:39.539574 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 5/14] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:12:39 2022] DELETE /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:12:39.553497 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9c767434-ef95-4285-b838-31ed1b52f524 tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Calling method '.version_select at 0x7fadbd9bc040>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:39.618846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9c767434-ef95-4285-b838-31ed1b52f524 tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d" status: 200 len: 353 microversion: 2.1 time: 0.074045 Jul 20 09:12:39.620382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 10/15] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:39 2022] GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:40.038212 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7973cacd-7760-4db4-b0ff-4e00674f2408 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda20820>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:40.171742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7973cacd-7760-4db4-b0ff-4e00674f2408 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/0e24ecfa-3f13-4a88-b10a-788e872b8000" status: 200 len: 351 microversion: 2.1 time: 0.137264 Jul 20 09:12:40.178025 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 6/16] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:40 2022] GET /compute/v2.1/os-volumes/0e24ecfa-3f13-4a88-b10a-788e872b8000 => generated 351 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:40.634616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aa5575b5-94f3-4827-9b55-e39c760cc81c tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Calling method '.version_select at 0x7fadbd955040>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:40.704498 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-aa5575b5-94f3-4827-9b55-e39c760cc81c tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] HTTP exception thrown: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aa5575b5-94f3-4827-9b55-e39c760cc81c tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Request method failure captured: Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d HTTP/1.1 Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cCnbaCxt9jyDYM5gRIyI6lcuApiXFbrcmROsUOb1pbi4dSng97OJcYTNjKsLL-1SF4kJRDCYnYhKF0wg6tfNu3ctdXFh0h1B7a29MT2lgo5aGKx3KVInNhFzNAnhw9pLzwI5PvmhpBRYnL-Ohv-iyvkiGdAATWy9F8WKHOpD0yKCE Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: f571b8b6410349418219f9d80d2df4fd Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesGetTestJSON-309152903 Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:12:40.707259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f571b8b6410349418219f9d80d2df4fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f571b8b6410349418219f9d80d2df4fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f571b8b6410349418219f9d80d2df4fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f571b8b6410349418219f9d80d2df4fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesGetTestJSON-309152903 Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: f571b8b6410349418219f9d80d2df4fd Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesGetTestJSON-309152903 Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesGetTestJSON-309152903-project Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 307f7fbfe4ff45daba698c930b1faff3 Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesGetTestJSON-309152903-project Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'e308daaa-644a-4d57-a3bc-d717e1f6556d'} Jul 20 09:12:40.708530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. (HTTP 404) (Request-ID: req-0497e683-9d47-4bf5-8bde-b07b96cfa263) Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:40.709112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:12:40.710256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:12:40.711894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. Jul 20 09:12:40.712814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:12:40.716418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aa5575b5-94f3-4827-9b55-e39c760cc81c tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] Returning 404 to user: Volume e308daaa-644a-4d57-a3bc-d717e1f6556d could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:12:40.717652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aa5575b5-94f3-4827-9b55-e39c760cc81c tempest-VolumesGetTestJSON-309152903 tempest-VolumesGetTestJSON-309152903-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d" status: 404 len: 109 microversion: 2.1 time: 0.089253 Jul 20 09:12:40.723245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 11/17] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:40 2022] GET /compute/v2.1/os-volumes/e308daaa-644a-4d57-a3bc-d717e1f6556d => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:12:42.528583 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-62600b3d-2895-45bc-9027-c0a8a6a6cea8 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda39c10>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:42.787927 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-62600b3d-2895-45bc-9027-c0a8a6a6cea8 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/75cec9dd-c084-45f4-9b19-02b0bab0a868" status: 200 len: 351 microversion: 2.1 time: 0.265047 Jul 20 09:12:42.788523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 7/18] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:12:42 2022] GET /compute/v2.1/os-volumes/75cec9dd-c084-45f4-9b19-02b0bab0a868 => generated 351 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:12:42.820132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b551143a-edc0-4985-919b-09c665e30d7e tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbd9a5940>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:43.313247 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b551143a-edc0-4985-919b-09c665e30d7e tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.514392 Jul 20 09:12:43.315619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 12/19] 10.222.0.44 () {58 vars in 1133 bytes} [Wed Jul 20 09:12:42 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:43.339973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5bd785a4-971a-4335-9064-240675c7eb4a tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda393a0>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:43.664297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5bd785a4-971a-4335-9064-240675c7eb4a tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.336988 Jul 20 09:12:43.665144 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 8/20] 10.222.0.44 () {58 vars in 1148 bytes} [Wed Jul 20 09:12:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:12:43.689434 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-50d19c0c-6085-4080-8f90-ddb460857ac2 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbd9bcd30>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:43.923681 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-50d19c0c-6085-4080-8f90-ddb460857ac2 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.244792 Jul 20 09:12:43.924528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 13/21] 10.222.0.44 () {58 vars in 1133 bytes} [Wed Jul 20 09:12:43 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:43.936257 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0a2a6609-2b59-4eda-ada3-f571ce3e699d tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda39160>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:44.163190 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0a2a6609-2b59-4eda-ada3-f571ce3e699d tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.231535 Jul 20 09:12:44.164219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 9/22] 10.222.0.44 () {58 vars in 1166 bytes} [Wed Jul 20 09:12:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:44.179841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-877db252-86f7-4d03-b3fe-54e838f22518 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda87700>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:44.401593 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-877db252-86f7-4d03-b3fe-54e838f22518 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.226153 Jul 20 09:12:44.402795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 14/23] 10.222.0.44 () {58 vars in 1169 bytes} [Wed Jul 20 09:12:44 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:44.419298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c8a0f0ac-d59c-46ce-85f5-12c1ad49e2f0 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda20dc0>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:44.736994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c8a0f0ac-d59c-46ce-85f5-12c1ad49e2f0 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.323789 Jul 20 09:12:44.737844 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 10/24] 10.222.0.44 () {58 vars in 1154 bytes} [Wed Jul 20 09:12:44 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:44.749655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-44010a85-878f-4d06-9e3e-85a9a4b833ec tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbd9c1550>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:45.053072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-44010a85-878f-4d06-9e3e-85a9a4b833ec tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.307597 Jul 20 09:12:45.054646 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 15/25] 10.222.0.44 () {58 vars in 1187 bytes} [Wed Jul 20 09:12:44 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:45.069850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1d1774ea-afef-4e6e-999c-252d90baf139 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] Calling method '.version_select at 0x7fadbda32670>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:45.349150 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1d1774ea-afef-4e6e-999c-252d90baf139 tempest-VolumesTestJSON-1813844135 tempest-VolumesTestJSON-1813844135-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.283907 Jul 20 09:12:45.350413 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 11/26] 10.222.0.44 () {58 vars in 1154 bytes} [Wed Jul 20 09:12:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:51.880815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-995285485", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:52.152378 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] validate_networks() for [('b56ab455-e1e9-413d-bca3-4d8a7c9b346e', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:12:53.462037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-127a913b-35aa-4b22-9e8f-093e09e9e8f4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: .version_select at 0x7fadbda32dc0>, body: {"keypair": {"name": "tempest-keypair-311198942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO1bVluo/rtiheYFICbzOPQI0XVqe+oupGbSKy+U0N32HIo0EXiGmgg7lKRgQDPcvYawlB7Zq0pUhrFXXh/DleNXiezs+JMTp5zKdhycAEJMZF+HJVn+zODQWHBWa9qulw=="}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:53.572666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-127a913b-35aa-4b22-9e8f-093e09e9e8f4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:12:53.583626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-127a913b-35aa-4b22-9e8f-093e09e9e8f4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:12:53.721833 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-127a913b-35aa-4b22-9e8f-093e09e9e8f4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.790524 Jul 20 09:12:53.729694 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 12/27] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:12:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:12:53.886342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-834f795f-a930-47d5-87b5-9e6d2a95958e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'create', calling method: .version_select at 0x7fadbd98f820>, body: {"keypair": {"name": "tempest-keypair-203854448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBS2mWirKMAJPxjZPwqLPKdssKRrw776q5XYo5OsqzSxjMgyfKxl6K6jYJCbOw/SYXGzizWftqvV5pT7b7qxrJCdVBqKBpc7u6Jq7mbRPkZsiG8dILjF5uMsmlTdR+da9Q=="}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:53.939191 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-834f795f-a930-47d5-87b5-9e6d2a95958e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for project 752497421a0b4c70a08bcca4393b8837. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:12:53.951039 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-834f795f-a930-47d5-87b5-9e6d2a95958e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for user f0547075e10c498b8d13e1859197cea0 and project 752497421a0b4c70a08bcca4393b8837. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:12:54.002930 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-834f795f-a930-47d5-87b5-9e6d2a95958e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.270954 Jul 20 09:12:54.003588 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 13/28] 10.222.0.44 () {62 vars in 1199 bytes} [Wed Jul 20 09:12:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 273 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 09:12:55.250644 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:12:55.251156 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:12:55.251569 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:12:55.251982 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:12:55.252391 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:12:55.317648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:12:55.322434 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:12:55.326358 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:12:55.329879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:12:55.471396 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:12:55.488191 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for user abdb339c5f5740d6aff4dfd1066f9384 and project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:12:55.539070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:12:55.558501 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:12:55.776384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-31d0697c-ff1d-44e1-9a80-af0ba690748e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.308672 Jul 20 09:12:55.786080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 16/29] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:12:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 4327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:12:55.796029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-eaa06b72-6b3b-4714-b58a-93b0be5be28c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:55.797014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-eaa06b72-6b3b-4714-b58a-93b0be5be28c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:12:56.100142 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eaa06b72-6b3b-4714-b58a-93b0be5be28c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:12:56.130010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-eaa06b72-6b3b-4714-b58a-93b0be5be28c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1221 microversion: 2.1 time: 0.342300 Jul 20 09:12:56.131809 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 14/30] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:12:55 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1221 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:56.370381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2031667861", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "networks": [{"uuid": "b02cc8f4-092e-4f18-bead-06d25f865945"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:56.478217 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] validate_networks() for [('b02cc8f4-092e-4f18-bead-06d25f865945', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:12:56.609443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1534194335", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:12:56.806561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] validate_networks() for [('b56ab455-e1e9-413d-bca3-4d8a7c9b346e', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:12:57.822333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:12:57.823234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:12:57.823802 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:12:57.824289 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:12:57.824782 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:12:57.842154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:12:57.851864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:12:57.854081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:12:57.857883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:12:57.935881 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Getting quotas for project e286919dacfc4db1a83308683c2a23ba. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:12:57.952916 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Getting quotas for user a24a58daa8ed4d77a649a670cc358638 and project e286919dacfc4db1a83308683c2a23ba. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:12:57.979577 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:12:57.982276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:12:58.131603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c3577534-099e-44a8-8a3b-8c4f23026ba4 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.235819 Jul 20 09:12:58.141729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 17/31] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:12:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2247 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:12:58.147386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0d816db8-4602-4ce5-a70b-bceaaeb13f62 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:58.152417 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0d816db8-4602-4ce5-a70b-bceaaeb13f62 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:12:58.446134 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0d816db8-4602-4ce5-a70b-bceaaeb13f62 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:12:58.483407 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0d816db8-4602-4ce5-a70b-bceaaeb13f62 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1215 microversion: 2.1 time: 0.340502 Jul 20 09:12:58.505625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 18/32] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:12:58 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1215 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:58.641788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:12:58.642593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:12:58.643116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:12:58.643832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:12:58.644296 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:12:58.673533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:12:58.675669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:12:58.678669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:12:58.679423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:12:58.761263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:12:58.776582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for user abdb339c5f5740d6aff4dfd1066f9384 and project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:12:58.814152 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:12:58.824690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:12:59.011838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4e21526b-2e9f-4937-873f-9a72b7792532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.410665 Jul 20 09:12:59.013008 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 15/33] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:12:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:12:59.023015 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-435a2d44-5aa2-4c1c-acec-e9aba99e3ae7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:59.025600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-435a2d44-5aa2-4c1c-acec-e9aba99e3ae7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:12:59.272956 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-435a2d44-5aa2-4c1c-acec-e9aba99e3ae7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:12:59.287580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-435a2d44-5aa2-4c1c-acec-e9aba99e3ae7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1222 microversion: 2.1 time: 0.263214 Jul 20 09:12:59.295102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 19/34] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:12:59 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1222 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:12:59.507819 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-eca3bd39-8385-4d06-9ae7-d23b816852b0 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:12:59.509020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-eca3bd39-8385-4d06-9ae7-d23b816852b0 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:12:59.633067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eca3bd39-8385-4d06-9ae7-d23b816852b0 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:12:59.643036 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-eca3bd39-8385-4d06-9ae7-d23b816852b0 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1215 microversion: 2.1 time: 0.140774 Jul 20 09:12:59.644985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 16/35] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:12:59 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1215 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:00.315481 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-29aef086-26b9-4a67-9ad8-f3419905093a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:00.316264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-29aef086-26b9-4a67-9ad8-f3419905093a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:00.366790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-922351314", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82594896-6626-4a61-89e5-7b2f2a36363e"}], "security_groups": [{"name": "tempest-securitygroup--720655817"}], "key_name": "tempest-keypair-311198942", "user_data": "}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:00.663828 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-29aef086-26b9-4a67-9ad8-f3419905093a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:00.672475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-29aef086-26b9-4a67-9ad8-f3419905093a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1222 microversion: 2.1 time: 0.364725 Jul 20 09:13:00.673062 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 20/36] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:00 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1222 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:00.698787 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1688857803", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5be41c5-b866-4e37-838a-7883c8ccd3e7"}], "security_groups": [{"name": "tempest-securitygroup--266179142"}], "key_name": "tempest-keypair-203854448", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:01.099362 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] validate_networks() for [('82594896-6626-4a61-89e5-7b2f2a36363e', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:13:01.714137 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] validate_networks() for [('c5be41c5-b866-4e37-838a-7883c8ccd3e7', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:13:05.070996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:13:05.072104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:13:05.073175 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:13:05.073788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:13:05.074354 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:13:05.084616 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:05.085242 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:05.086216 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:05.086866 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:05.112094 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:13:05.131982 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:13:05.157616 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:13:05.160834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:13:05.279091 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7fa0c8cb-cadc-468d-9d77-159f0016e42c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.919902 Jul 20 09:13:05.292814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 17/37] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:13:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 4934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:13:05.313892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:05.315425 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:05.327996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:05.328459 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:05.341008 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:05.341472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:06.749580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:13:06.751948 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:13:06.754767 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:13:06.755448 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:13:06.757796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:13:06.820777 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:06.822005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:06.825376 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:06.827486 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:06.913960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for project 752497421a0b4c70a08bcca4393b8837. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:13:06.922419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for user f0547075e10c498b8d13e1859197cea0 and project 752497421a0b4c70a08bcca4393b8837. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:13:06.971522 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:13:06.986661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:13:07.188189 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7cfbae18-65fc-4e25-8351-133a36ff7b5c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.514032 Jul 20 09:13:07.201178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 21/38] 10.222.0.44 () {62 vars in 1187 bytes} [Wed Jul 20 09:13:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 6527 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 09:13:07.232554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:07.235832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:07.251847 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:07.279802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6e680ffa-04ef-4c46-a490-9bd2ed64e80c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 1.985591 Jul 20 09:13:07.283960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:07.285296 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:07.286597 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:07.287224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:07.288046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 18/39] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:05 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 1995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:07.300130 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:07.306717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:07.339341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:07.343750 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:07.353708 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:07.354640 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:07.735784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:07.768702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e1228056-58ef-4c04-801b-ffbd84c9fa6b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1244 microversion: 2.1 time: 0.477006 Jul 20 09:13:07.769313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 19/40] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:07 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1244 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:07.827098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4c625019-1322-4c0f-a0e4-59c7c99a24f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:07.827788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4c625019-1322-4c0f-a0e4-59c7c99a24f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:08.267731 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c625019-1322-4c0f-a0e4-59c7c99a24f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:08.278625 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c625019-1322-4c0f-a0e4-59c7c99a24f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:08.283432 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c625019-1322-4c0f-a0e4-59c7c99a24f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:08.291249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4c625019-1322-4c0f-a0e4-59c7c99a24f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1281 microversion: 2.20 time: 0.481127 Jul 20 09:13:08.308034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:07 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1281 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:08.313208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:08.322488 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:08.349389 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:08.351477 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:08.363940 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:08.364510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:09.640160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:09.664491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-01279557-de76-4af2-8698-c90e09082294 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 2.461820 Jul 20 09:13:09.665972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 22/42] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:07 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 2464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:09.678659 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:09.679488 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:09.694163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:09.695026 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:09.696054 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:09.697440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:09.776715 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:09.793870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-23ccc7ff-9b9f-4fe5-8167-78002d6311ae tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 1.491843 Jul 20 09:13:09.794768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 21/43] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:08 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:09.807959 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:09.811486 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:09.827654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:09.828339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:09.829369 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:09.830042 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:10.043344 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:10.058718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-52161c9f-5540-47ee-9963-03916d53dd2d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1298 microversion: 2.1 time: 0.386043 Jul 20 09:13:10.062655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 23/44] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:09 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1298 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:10.126953 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:10.141745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:10.144297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:10.173032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-eb45ca08-51b3-4195-8e52-41ae47d870e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1333 microversion: 2.20 time: 0.366173 Jul 20 09:13:10.177722 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:09 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1333 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:10.690752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:10.698280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:10.715284 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:10.716641 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:10.718620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:10.719426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:10.817302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:10.818541 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:10.836446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:10.837701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:10.850925 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:10.852056 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:11.513525 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:11.536261 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b5e2c9e8-2314-4cf9-8adb-b404fafd681e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.849672 Jul 20 09:13:11.550536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 24/46] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:10 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:11.575651 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:11.576657 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:11.591803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:11.592475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:11.593522 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:11.594758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:11.973428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:11.986488 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-98ab36c3-4f7d-43c9-b3f1-9ef07a29ed95 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1298 microversion: 2.1 time: 0.430170 Jul 20 09:13:11.987130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 25/47] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:11 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1298 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:12.014670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:12.015387 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:12.036273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:12.039486 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:12.040368 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:12.041114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:12.062410 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:12.076900 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-47c22423-58e3-4352-a2a8-be57f427bdb8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 1.269204 Jul 20 09:13:12.077508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 23/48] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:10 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:12.289372 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:12.318984 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:12.321041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:12.341910 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f52b42df-3320-45d9-9c70-2253e0a06cba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1339 microversion: 2.20 time: 0.353679 Jul 20 09:13:12.345286 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 26/49] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:11 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1339 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:12.554063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:12.555404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:12.598491 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:12.625546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:12.631264 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:12.632261 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:13.012555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:13.013281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:13.035750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:13.036590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:13.040283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:13.041568 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:13.872858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:13.895484 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c42f6fda-0029-429e-a6fa-4c550382e8e4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1298 microversion: 2.1 time: 0.892394 Jul 20 09:13:13.903239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 27/50] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:13 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1298 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:13.913486 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:13.915758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:13.929866 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:13.941620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:13.943643 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:13.951419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:14.823208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:14.839250 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c9da7fab-4536-4a2d-8408-f00878b50036 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 2.287475 Jul 20 09:13:14.845034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 24/51] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:12 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:14.873186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:14.877674 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:14.914776 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:14.915791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:14.916582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:14.937209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:15.101786 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=4 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:15.776803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:15.789319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-481fc1df-cef4-47fd-add7-e0ef8a8456e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 1.884616 Jul 20 09:13:15.792603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 28/52] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:13 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 1889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:15.921143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-5b7b704d-53f4-4e16-ad4f-9fc30d59de0a req-fab88199-016b-4d0a-baba-d30d3988eeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e44b07d-866d-4c46-b8d0-1330d3387ebe", "tag": "ae0466e4-d8c3-4cec-9a2b-af74121afd36"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:15.961475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-5b7b704d-53f4-4e16-ad4f-9fc30d59de0a req-fab88199-016b-4d0a-baba-d30d3988eeef service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:15.964277 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-5b7b704d-53f4-4e16-ad4f-9fc30d59de0a req-fab88199-016b-4d0a-baba-d30d3988eeef service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.029395 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-5b7b704d-53f4-4e16-ad4f-9fc30d59de0a req-fab88199-016b-4d0a-baba-d30d3988eeef service nova] Creating event network-changed:ae0466e4-d8c3-4cec-9a2b-af74121afd36 for instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe on hv-cinder-84330 Jul 20 09:13:16.035248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-5b7b704d-53f4-4e16-ad4f-9fc30d59de0a req-fab88199-016b-4d0a-baba-d30d3988eeef service nova] Acquired lock "compute-rpcapi-router" {{(pid=117871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 09:13:16.039526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:16.045491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.048514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:16.051695 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.091369 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.compute.rpcapi [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 09:13:16.095327 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] Releasing lock "compute-rpcapi-router" {{(pid=117871) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 09:13:16.143740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d656a44d-59b7-46ff-83e2-e13dde7d954e None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.347230 Jul 20 09:13:16.146474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 29/53] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:16.170891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:16.189171 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:16.221447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:16.223447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.226647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:16.229086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.510836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:16.520940 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:16.532761 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:16.535236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b42395cb-0b62-4c2b-a6f7-d9e28d44dd0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 1.687845 Jul 20 09:13:16.548652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 25/54] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:14 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:16.560470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:16.561850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:16.567967 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=8 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:16.569947 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:16.570922 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.581731 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:16.582282 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:16.635376 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:16.661129 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-239c79a9-835a-4917-a2f7-76f663deff0d tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1298 microversion: 2.1 time: 0.510391 Jul 20 09:13:16.661725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 30/55] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:16 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1298 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:16.952605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=24 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:16.986769 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-bfbefe82-cae8-47a2-ac2c-15075b250b28 req-e85fe6b7-ff35-4679-97d6-a89a69858426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b882a32-6794-4188-824a-7d2e1c061e67", "tag": "81e28f7f-49b2-4bf3-a0f2-30ff46f71e2c"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:17.007045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-bfbefe82-cae8-47a2-ac2c-15075b250b28 req-e85fe6b7-ff35-4679-97d6-a89a69858426 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.014003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-bfbefe82-cae8-47a2-ac2c-15075b250b28 req-e85fe6b7-ff35-4679-97d6-a89a69858426 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:17.046963 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-bfbefe82-cae8-47a2-ac2c-15075b250b28 req-e85fe6b7-ff35-4679-97d6-a89a69858426 service nova] Creating event network-changed:81e28f7f-49b2-4bf3-a0f2-30ff46f71e2c for instance 4b882a32-6794-4188-824a-7d2e1c061e67 on hv-cinder-84330 Jul 20 09:13:17.054230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-bfbefe82-cae8-47a2-ac2c-15075b250b28 req-e85fe6b7-ff35-4679-97d6-a89a69858426 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.391235 Jul 20 09:13:17.059693 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 31/56] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:17.085721 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:17.091874 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:17.093677 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:17.098583 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e9f46892-73e7-4106-9c63-e92d2840ddea tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.544782 Jul 20 09:13:17.104383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 26/57] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:16 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:17.105041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.106469 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:17.108465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.109509 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:17.425544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:17.436708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b783435f-19cb-47bf-a509-1332ac102101 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.375190 Jul 20 09:13:17.447887 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 32/58] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:17 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:17.565973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:17.566601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:17.576628 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.577151 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:17.577953 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.578575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:17.681891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:17.682903 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:17.712293 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.715760 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:17.717088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:17.722185 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:18.066349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:18.083600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:18.087716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:18.090852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-deb25fc1-1b15-47eb-8628-11392bc17eb1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.541234 Jul 20 09:13:18.113954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 27/59] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:17 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:18.131467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:18.133523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:18.144928 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:18.147892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:18.151967 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:18.153437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:18.216598 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:18.228283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-73312c54-7e2f-46f5-b68c-f3270754d2de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.552838 Jul 20 09:13:18.238225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 33/60] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:17 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:18.273766 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=26 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:18.434445 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:18.447829 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-56d9d0b8-c906-415b-a34c-f34b4160be72 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.330604 Jul 20 09:13:18.454503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:18.455144 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:18.456516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 28/61] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:18 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:18.472267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:18.472954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:18.474322 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:18.474793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:18.783061 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:18.794713 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ecd66968-c2ca-4737-ae09-abc200d11de1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.344663 Jul 20 09:13:18.806211 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 34/62] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:18 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:19.133125 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:19.135105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:19.150905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.151104 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-e1d50e68-0a6c-4f9e-91ac-5f5b47bdd901 req-eee21744-ed0c-4e8b-a47d-e500439d25fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06b84992-1120-4e6d-be2e-f66d530b5ed4", "tag": "82fdf704-5224-44e3-afb6-ab44f9ffc40a"}, {"name": "network-changed", "server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:19.152009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.153969 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.155139 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.170830 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-e1d50e68-0a6c-4f9e-91ac-5f5b47bdd901 req-eee21744-ed0c-4e8b-a47d-e500439d25fe service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.171337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-e1d50e68-0a6c-4f9e-91ac-5f5b47bdd901 req-eee21744-ed0c-4e8b-a47d-e500439d25fe service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.207206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-e1d50e68-0a6c-4f9e-91ac-5f5b47bdd901 req-eee21744-ed0c-4e8b-a47d-e500439d25fe service nova] Creating event network-changed:82fdf704-5224-44e3-afb6-ab44f9ffc40a for instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 on hv-cinder-84330 Jul 20 09:13:19.207987 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-e1d50e68-0a6c-4f9e-91ac-5f5b47bdd901 req-eee21744-ed0c-4e8b-a47d-e500439d25fe service nova] Creating event network-changed:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:13:19.216930 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-e1d50e68-0a6c-4f9e-91ac-5f5b47bdd901 req-eee21744-ed0c-4e8b-a47d-e500439d25fe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.069928 Jul 20 09:13:19.229362 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 35/63] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:13:19.245442 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:19.246152 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:19.256746 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.257196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.261726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.263029 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.652034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:19.661297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:19.667657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:19.669895 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c4ed0698-5248-4f24-9ad8-f0635649710c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.540932 Jul 20 09:13:19.676819 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 29/64] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:19 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:19.694656 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:19.701526 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:19.715855 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.716408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.717270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.717784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.737599 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:19.755056 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-66dbb887-8e21-4592-8b4e-2b97518d1e42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.505172 Jul 20 09:13:19.756006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 36/65] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:19 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:19.812107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:19.812818 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:19.820099 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.823301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.824415 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:19.827051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:19.918823 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:19.928152 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-adbb16d4-748e-41f3-bcce-fe132281222f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.238831 Jul 20 09:13:19.928743 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 30/66] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:19 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:20.003832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:20.011485 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f29b3b60-e636-4671-8731-59b785ab4124 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.203296 Jul 20 09:13:20.012483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 37/67] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:19 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:20.694228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:20.695118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:20.702762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:20.703502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:20.704802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:20.705649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:20.773178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:20.775225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:20.783530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:20.784437 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:20.785676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:20.786266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:20.924117 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:20.936496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:20.938274 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:20.939614 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-299f2f39-b88f-45a9-b51d-cfd679b80c5e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.250000 Jul 20 09:13:20.942194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 31/68] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:20 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:20.947657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:20.948720 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:20.955056 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:20.955717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:20.957014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:20.957608 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:20.964320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:20.973039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c280d77f-1e7d-4114-aba2-63ed8caccaa8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.204321 Jul 20 09:13:20.982647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 38/69] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:20 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:21.028948 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:21.029568 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:21.039661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:21.041037 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:21.041845 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:21.042288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:21.047949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:21.167985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:21.180194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-72443310-b701-4b57-8bca-d0a9a0e972c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.236410 Jul 20 09:13:21.190716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 32/70] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:20 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:21.230573 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:21.239509 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3d636791-0da4-4e73-b819-e5d5093052e6 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.214174 Jul 20 09:13:21.240105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 39/71] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:21 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:21.964026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:21.965188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:21.971432 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:21.971983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:21.972828 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:21.973337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:21.989633 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:21.990366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:21.997746 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:21.999335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:22.000792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:22.001723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:22.002329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:22.199002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:22.208046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:22.209563 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:22.210692 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-785b9cc7-e740-4ba2-a086-b5bda973b40c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.253526 Jul 20 09:13:22.211427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 33/72] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:21 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:22.222048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:22.228534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:22.229330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:22.229705 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d3dea5e4-bce3-4701-bb5a-ad4f4446e0c4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.244130 Jul 20 09:13:22.230276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 40/73] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:21 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:22.235626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:22.236078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:22.236849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:22.237283 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:22.260817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:22.262022 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:22.270243 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:22.270990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:22.271955 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:22.272438 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:22.504797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:22.509467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=100 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:22.514505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8fbecaa5-1ebb-44d1-976d-d653f3ccbfa2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.290638 Jul 20 09:13:22.527768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 34/74] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:22 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:22.555489 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:22.564049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d193e1cb-8d9c-4960-af42-4d9f98177738 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.309921 Jul 20 09:13:22.564619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 41/75] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:22 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:23.231318 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:23.232005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:23.247406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.247530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:23.247939 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.248031 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:23.252286 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.254733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.262039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.262565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.264433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.267266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.744785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:23.754100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:23.756149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:23.757286 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6a8580fc-18fe-41c8-a4de-3e0cbe67c105 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.531490 Jul 20 09:13:23.758380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 35/76] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:23 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:23.764473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:23.765892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:23.772282 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.772977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.773945 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.775604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.869966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:23.880992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad0f8f65-30fc-483e-9e45-4699c57f9772 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.639124 Jul 20 09:13:23.893246 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 42/77] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:23 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:23.898822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:23.899956 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:23.908155 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.908838 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:23.909838 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:23.910479 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.129132 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:24.140732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d7094919-b63f-432f-b1a8-3b2103519656 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.380492 Jul 20 09:13:24.143624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 36/78] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:23 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:24.150311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-0b5f0037-9bcf-4218-b74f-eebb93f0e968 req-01210293-407b-4b23-9885-0bb5bca06b2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec129daf-9e04-4ed9-bd69-a27ebf04ed38", "tag": "1c2570cd-92fc-4346-a17c-e398ca95634d"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:24.174231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:24.181182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-0b5f0037-9bcf-4218-b74f-eebb93f0e968 req-01210293-407b-4b23-9885-0bb5bca06b2c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.184266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-0b5f0037-9bcf-4218-b74f-eebb93f0e968 req-01210293-407b-4b23-9885-0bb5bca06b2c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.186625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-80e101fb-ac81-46cb-9ca7-b05febf83f06 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.291793 Jul 20 09:13:24.187473 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 43/79] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:23 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:24.227243 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-0b5f0037-9bcf-4218-b74f-eebb93f0e968 req-01210293-407b-4b23-9885-0bb5bca06b2c service nova] Creating event network-changed:1c2570cd-92fc-4346-a17c-e398ca95634d for instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 on hv-cinder-84330 Jul 20 09:13:24.228240 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-0b5f0037-9bcf-4218-b74f-eebb93f0e968 req-01210293-407b-4b23-9885-0bb5bca06b2c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 20 09:13:24.229382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.229811 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.230604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.239684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.261166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.compute.rpcapi [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 20 09:13:24.264653 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] Releasing lock "compute-rpcapi-router" {{(pid=117872) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 20 09:13:24.300227 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-75593adb-5c3f-4b31-9284-e2a90bc0952d None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154990 Jul 20 09:13:24.301328 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 37/80] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:24.777739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:24.778362 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:24.786237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.786741 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.787749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.788674 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.901774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:24.902493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:24.910979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.912116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.913085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:24.913675 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:24.962794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:24.975003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:24.983418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:24.984832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-38577d02-e1d2-4a64-b5bc-f1b939b1e652 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.212120 Jul 20 09:13:24.985807 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 44/81] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:24 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:13:25.088611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:25.096954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6a7f96b9-a73f-427c-9081-d15fc2c9a8b9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.200257 Jul 20 09:13:25.097536 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 38/82] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:24 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:25.160363 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:25.161375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:25.172211 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:25.172801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:25.173752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:25.174368 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:25.208901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:25.209552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:25.222042 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:25.222501 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:25.223313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:25.223938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:25.504256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:25.513706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7f7e916a-1d48-45f8-81b3-c78bf406ed08 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.357334 Jul 20 09:13:25.515792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 45/83] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:25 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:25.551368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:25.561451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-eb96e579-b890-482c-b925-5546afe79b6d tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.359240 Jul 20 09:13:25.572510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 39/84] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:25 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:26.003942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:26.004554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:26.011667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.012300 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.013079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.013525 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.077399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=8 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:26.118101 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:26.120081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:26.129684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.130578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.131985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.132617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.180128 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:26.190371 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:26.197088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:26.198954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8779190f-bc18-4596-8939-cde95c7bef71 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.199008 Jul 20 09:13:26.200549 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 46/85] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:25 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:26.313342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:26.326461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-07419620-7992-4770-afbd-109f94e0480e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.215180 Jul 20 09:13:26.337698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 40/86] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:26 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:26.543499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:26.544386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:26.552079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.552990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.554141 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.554813 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.581939 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:26.582559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:26.592785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.593855 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.594640 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:26.595113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:26.785295 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:26.794539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d298b4c9-2268-4a15-b429-44a81050eb23 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.255779 Jul 20 09:13:26.802645 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 47/87] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:26 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:26.997068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:27.015113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-68d3f8df-9dfc-4a39-9168-857eb802a156 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.438657 Jul 20 09:13:27.019048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 41/88] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:26 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:27.220080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:27.221256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:27.236848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:27.237442 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:27.239966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:27.240440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:27.347910 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:27.349196 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:27.362039 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:27.363217 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:27.366519 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:27.385869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:27.718570 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:27.740901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:27.742360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:27.749725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2be54df2-7875-46bd-84ae-12aeaf193a7e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.535609 Jul 20 09:13:27.762818 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 48/89] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:27 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:27.763897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:27.773005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bfcaaa65-1a73-41de-831c-2b523d19ca42 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.429868 Jul 20 09:13:27.776024 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 42/90] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:27 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:27.818917 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:27.819541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:27.829548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:27.830426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:27.831461 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:27.832109 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.035976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:28.037310 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:28.048659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.051957 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.053382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.053983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.128359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:28.144510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cd751027-546b-4c42-8b1b-3f6903ba8fee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.329296 Jul 20 09:13:28.150406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 49/91] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:27 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:28.602986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:28.613559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2062ead6-6e98-4564-8204-d901968bab34 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.581553 Jul 20 09:13:28.615227 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 43/92] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:28 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:28.693266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-dac25ddd-af81-4b63-803c-1994a577d93c req-25b008d4-9d17-4fb6-a255-d5d58739d55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44b07d-866d-4c46-b8d0-1330d3387ebe", "name": "network-vif-plugged", "status": "completed", "tag": "ae0466e4-d8c3-4cec-9a2b-af74121afd36"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:28.703677 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-dac25ddd-af81-4b63-803c-1994a577d93c req-25b008d4-9d17-4fb6-a255-d5d58739d55d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.704374 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-dac25ddd-af81-4b63-803c-1994a577d93c req-25b008d4-9d17-4fb6-a255-d5d58739d55d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.725761 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-dac25ddd-af81-4b63-803c-1994a577d93c req-25b008d4-9d17-4fb6-a255-d5d58739d55d service nova] Creating event network-vif-plugged:ae0466e4-d8c3-4cec-9a2b-af74121afd36 for instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe on hv-cinder-84330 Jul 20 09:13:28.731876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-dac25ddd-af81-4b63-803c-1994a577d93c req-25b008d4-9d17-4fb6-a255-d5d58739d55d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273668 Jul 20 09:13:28.732486 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 50/93] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:13:28.772702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:28.773456 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:28.787700 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.788208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.789020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.791062 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.795576 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:28.796686 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:28.810425 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.810991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:28.812560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:28.813926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:29.138162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:29.151651 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:29.153380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:29.158129 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:29.166259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1941476d-2754-46fc-814a-484ded8eb37e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.388063 Jul 20 09:13:29.168561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 44/94] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:28 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:29.179122 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-57a82304-8c3f-4027-b6c4-0a539b869408 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.390063 Jul 20 09:13:29.180022 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 51/95] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:28 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:29.190090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:29.190951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:29.198804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:29.199443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:29.200373 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:29.200963 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:29.441849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:29.455004 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-03683cce-1675-4ca8-8fad-24a06ea0e5e9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.284628 Jul 20 09:13:29.459285 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 45/96] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:29 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:29.631801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:29.632426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:29.639023 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:29.639695 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:29.640663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:29.641412 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:29.803948 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:29.812459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4a4eedc5-b22f-4b9f-a127-03e64301c3fd tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.184480 Jul 20 09:13:29.813163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 52/97] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:29 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:30.186199 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:30.186947 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:30.194866 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.195654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.199042 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.200603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:30.200728 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.201773 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:30.209520 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.210283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.212065 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.212655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.461175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:30.466154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:30.473072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-35c65a67-b774-4c2a-8da8-b80e7d0544ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.280696 Jul 20 09:13:30.478905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:30.478905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:30.479333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-48d4a5a9-c4a3-4047-8866-fda4736b8bb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.297161 Jul 20 09:13:30.482897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 53/98] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:30 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:30.490315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:30.491709 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:30.492490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 46/99] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:30 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:30.501727 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.502871 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.504349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.504911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.677848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:30.686716 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3b18b373-fc88-4985-a3ef-13394ee67a63 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.202294 Jul 20 09:13:30.696305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 54/100] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:30 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:30.829618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:30.830234 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:30.836444 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.836895 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:30.837865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:30.838751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.035832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:31.045092 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-28e10a92-69cc-47f3-a1ea-78a396abd72e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.219311 Jul 20 09:13:31.056002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 47/101] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:30 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:31.489269 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:31.489872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:31.497185 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:31.497827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.498770 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:31.498887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:31.499698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:31.500082 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.506993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:31.507591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.509153 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:31.509783 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.879033 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:31.881749 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:31.887590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-34afae8a-ee13-4b9d-b057-7b341a5412c7 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.402048 Jul 20 09:13:31.888247 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 55/102] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:31 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:31.890480 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:31.892036 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:31.892893 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:31.893149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-99802848-29b1-401a-a4c4-5bbef0191aa2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.398285 Jul 20 09:13:31.893705 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 48/103] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:31 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:13:31.893824 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:31.899775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:31.900225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.900986 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:31.901418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:31.919037 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:32.066391 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:32.068131 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:32.070370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:32.078047 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:32.081156 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:32.081673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bcf1b6dc-bc48-4358-a781-9688d17e8860 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.191341 Jul 20 09:13:32.082334 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 56/104] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:31 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:32.083201 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:32.083901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:32.223238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:32.231453 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9f52b1dd-01c0-47db-9242-f6e8297d3a8e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.172653 Jul 20 09:13:32.232690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 49/105] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:32 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:32.905294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:32.907180 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:32.911376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:32.912586 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:32.914274 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:32.915690 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:32.917275 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:32.917738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:32.920538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:32.921232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:32.922626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:32.923290 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:33.135247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:33.143452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:33.145102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:33.146348 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-40b5cead-42e0-4167-b0b2-8982398e0e9f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.238881 Jul 20 09:13:33.147021 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 50/106] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:32 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:33.147165 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:33.152643 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:33.153515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:33.156945 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-69ab6b37-5e9d-4901-8683-11aa0f61a310 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.255827 Jul 20 09:13:33.157521 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 57/107] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:32 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:33.170138 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:33.170605 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:33.171674 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:33.172123 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:33.250883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:33.251714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:33.269935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:33.270625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:33.271616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:33.272276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:33.316863 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:33.320915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=100 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:33.330125 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ae0cdfda-25d2-4ab2-99d4-2d5550693b76 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1322 microversion: 2.1 time: 0.181685 Jul 20 09:13:33.332714 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 51/108] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:33 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:33.475380 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:33.484123 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a24cc155-07f9-4f7e-83d2-e10a0ef7df8f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.238394 Jul 20 09:13:33.484886 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 58/109] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:33 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:34.179504 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:34.181121 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:34.181914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:34.182626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:34.197647 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.199208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.200504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.201228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.202041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.205648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.206819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.207347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.257070 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:34.439226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:34.444628 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:34.454474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:34.455080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-11412bcf-353c-4740-b110-f44146fb0ebd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.278744 Jul 20 09:13:34.465502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 59/110] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:34 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:34.466620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:34.467855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:34.468039 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:34.469637 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-642fa4b9-1f91-477b-bc87-7ba89976bc86 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.301528 Jul 20 09:13:34.471052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 52/111] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:34 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:34.476762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-5617089f-78e2-4678-94a1-09fbd0140b79 req-482a5921-115f-4ac8-86a3-a9c6935934b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b84992-1120-4e6d-be2e-f66d530b5ed4", "name": "network-vif-plugged", "status": "completed", "tag": "82fdf704-5224-44e3-afb6-ab44f9ffc40a"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:34.481000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.481683 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.483034 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.486402 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.491007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-5617089f-78e2-4678-94a1-09fbd0140b79 req-482a5921-115f-4ac8-86a3-a9c6935934b2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.491924 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-5617089f-78e2-4678-94a1-09fbd0140b79 req-482a5921-115f-4ac8-86a3-a9c6935934b2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.508588 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-5617089f-78e2-4678-94a1-09fbd0140b79 req-482a5921-115f-4ac8-86a3-a9c6935934b2 service nova] Creating event network-vif-plugged:82fdf704-5224-44e3-afb6-ab44f9ffc40a for instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 on hv-cinder-84330 Jul 20 09:13:34.515197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-5617089f-78e2-4678-94a1-09fbd0140b79 req-482a5921-115f-4ac8-86a3-a9c6935934b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042505 Jul 20 09:13:34.516149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 53/112] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:34.521206 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:34.521916 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:34.531068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.531533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.532740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.533194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.858789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:34.866794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1b22361c-d8fa-4fbe-bd55-8e9c5decd3c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1515 microversion: 2.1 time: 0.409038 Jul 20 09:13:34.867371 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 60/113] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:34 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1515 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:34.877013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:34.890592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1d94cb64-25ad-430f-ba7b-6ce59649c6af tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.373110 Jul 20 09:13:34.891199 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 54/114] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:34 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:34.894439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:34.895653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:34.903086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.903723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:34.904954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:34.905541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.017398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'flavor' on Instance uuid 9e44b07d-866d-4c46-b8d0-1330d3387ebe {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:13:35.215709 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ac89248c-8b29-4601-a208-77103ce0b5fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe/action" status: 200 len: 32 microversion: 2.1 time: 0.332273 Jul 20 09:13:35.217599 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 61/115] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:13:34 2022] POST /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe/action => generated 32 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:13:35.228783 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:35.231618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:35.248305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.248925 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.250142 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.250602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.473905 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:35.474619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:35.482869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:35.490933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-cf0e74c3-a3a1-497e-8194-3f0a503007f2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.268131 Jul 20 09:13:35.491519 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 55/116] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:35 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:35.501458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.501458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.501458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.501458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.512555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:35.514796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:35.523226 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.525340 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.526774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.527978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.770221 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:35.779519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-927c5af9-0b98-4c62-823f-e16f2dbeb1c1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.309966 Jul 20 09:13:35.783176 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 62/117] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:35 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:35.813763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:35.822755 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:35.825350 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:35.827023 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1a84032b-1f29-456c-9e35-771ca7daf939 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.334553 Jul 20 09:13:35.838364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 56/118] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:35 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:35.908960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:35.909767 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:35.921107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.921778 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:35.922725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:35.923190 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:36.210855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:36.223715 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2d35190d-e3bd-4b1a-b055-1c1e87b5f249 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1315 microversion: 2.1 time: 0.319110 Jul 20 09:13:36.236927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 63/119] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:35 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:36.510849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:36.512256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:36.520116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:36.521458 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:36.523258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:36.524258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:36.556100 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b882a32-6794-4188-824a-7d2e1c061e67", "name": "network-vif-plugged", "status": "completed", "tag": "81e28f7f-49b2-4bf3-a0f2-30ff46f71e2c"}, {"server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "name": "network-vif-plugged", "status": "completed", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}, {"server_uuid": "ec129daf-9e04-4ed9-bd69-a27ebf04ed38", "name": "network-vif-plugged", "status": "completed", "tag": "1c2570cd-92fc-4346-a17c-e398ca95634d"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:36.578874 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:36.579569 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:36.612359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] Creating event network-vif-plugged:81e28f7f-49b2-4bf3-a0f2-30ff46f71e2c for instance 4b882a32-6794-4188-824a-7d2e1c061e67 on hv-cinder-84330 Jul 20 09:13:36.613081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] Creating event network-vif-plugged:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:13:36.616267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] Creating event network-vif-plugged:1c2570cd-92fc-4346-a17c-e398ca95634d for instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 on hv-cinder-84330 Jul 20 09:13:36.629705 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-34219fe1-a05b-4451-91da-219fe3776576 req-10ce5dba-43ba-4ebf-984a-798c40b24402 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.088345 Jul 20 09:13:36.630646 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 64/120] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:36.810301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:36.811457 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:36.832449 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:36.838398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:36.839942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:36.840571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:36.958641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:36.971891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-60d9f2bb-622a-4597-9163-76fcebad0157 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.465500 Jul 20 09:13:36.986337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 57/121] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:36 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:36.997451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:36.998064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:37.005087 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:37.005545 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:37.006379 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:37.006905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:37.175527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:37.185550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f1a7f33f-4f70-4d94-92fa-098e28f01487 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.388654 Jul 20 09:13:37.186146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 65/122] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:36 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:37.242097 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:37.242979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:37.254405 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:37.254623 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:37.255472 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:37.255917 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:37.301660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:37.315553 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:37.321906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:37.324560 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-81aa0202-505e-418b-a593-d6fb18d6034c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.336357 Jul 20 09:13:37.325495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 58/123] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:36 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:37.469668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:37.493229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1938a7ea-bc2b-45be-91da-93a50658c6da tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1503 microversion: 2.1 time: 0.257015 Jul 20 09:13:37.493832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 66/124] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:37 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:37.988910 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:37.989999 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:38.000600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:38.001291 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:38.002259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:38.003447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:38.151445 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:38.159630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c5c0346a-1ac4-44f4-bfa7-ecfcdf1f4144 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.174390 Jul 20 09:13:38.160435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 59/125] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:37 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:38.205140 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:38.205758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:38.217501 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:38.218031 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:38.218937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:38.219540 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:38.343427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:38.344365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:38.352836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:38.353753 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:38.354789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:38.355461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:38.404648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:38.413726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f02dec8a-f360-455d-9f5e-f2c91ef77cf5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1365 microversion: 2.1 time: 0.214314 Jul 20 09:13:38.416176 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 67/126] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:38 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:38.640331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:38.649911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:38.652892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:38.654529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-cfa119d4-b843-4d3f-b0b7-78e34f811a37 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.315489 Jul 20 09:13:38.659016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 60/127] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:38 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:13:39.071986 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "983840c9-88de-4941-903e-d9904ceecfe0"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:39.073780 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:39.081055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.081631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.082790 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.083259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.182593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:39.184383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:39.198560 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.200569 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.203652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.204381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.427383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:39.437439 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-50df2f41-8a35-49d5-943f-acc081c7cd58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.261637 Jul 20 09:13:39.449090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 61/128] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:39 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:39.454078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:39.454981 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:39.463197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.463963 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.465160 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.465814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.714779 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:39.728077 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3cb2c6d1-660e-4432-a87f-13560d393383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1554 microversion: 2.1 time: 0.276305 Jul 20 09:13:39.740077 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 62/129] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:39 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1554 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:39.751629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:39.752452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:39.761058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.761792 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.762801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.763420 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.929038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:39.939148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:39.940857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:39.942377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2c8e6b7a-a1e8-48a4-96d9-19ca5e7ab412 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1406 microversion: 2.20 time: 0.200960 Jul 20 09:13:39.942979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 63/130] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:39 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1406 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:13:39.948873 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:39.949524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:39.956396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.957099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:39.958180 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:39.958630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:40.082926 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-31f09c8e-6912-4c02-8413-c09fd33cedbb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138407 Jul 20 09:13:40.083821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 64/131] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:13:39 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-interface => generated 284 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:40.457198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:40.458747 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:40.466065 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:40.466567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:40.467605 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:40.468125 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:40.659978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:40.671641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c10d8b5d-20cb-48a0-a5b8-ca0245dffe2d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.219856 Jul 20 09:13:40.672230 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 65/132] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:40 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:13:40.968507 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:40.970297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:40.980262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:40.980886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:40.981882 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:40.983592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:41.134480 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-71463e6a-c9c3-4a33-a8b9-8dfbe02920a2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "POST /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.065747 Jul 20 09:13:41.152163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 68/133] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:13:39 2022] POST /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4/os-volume_attachments => generated 194 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:41.316629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:41.332072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:41.333876 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:41.335294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7831f4a9-2d6b-48dd-a133-7cd05d0fd8e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1599 microversion: 2.20 time: 0.374538 Jul 20 09:13:41.335915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 66/134] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:13:40 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1599 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:13:41.357100 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:41.357506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:41.365901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:41.366645 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:41.367982 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:41.368586 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:41.547560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-afd72bd8-2e94-488d-b2cf-a4a4607b6aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.195740 Jul 20 09:13:41.548197 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 69/135] 10.222.0.44 () {60 vars in 1315 bytes} [Wed Jul 20 09:13:41 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:13:41.691401 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:41.692412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:41.704815 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:41.709323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:41.712174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:41.718801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:42.289542 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:42.300279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a9342ed5-9034-4b6d-9957-77168c11af78 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.614432 Jul 20 09:13:42.309792 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 67/136] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:41 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:42.453433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-69f294a0-7e0e-49e1-959c-c257a53c409b req-dd44f5f9-e5bd-41a8-b72b-e2511d488d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec129daf-9e04-4ed9-bd69-a27ebf04ed38", "tag": "1c2570cd-92fc-4346-a17c-e398ca95634d"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:42.469776 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-69f294a0-7e0e-49e1-959c-c257a53c409b req-dd44f5f9-e5bd-41a8-b72b-e2511d488d61 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:42.471030 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-69f294a0-7e0e-49e1-959c-c257a53c409b req-dd44f5f9-e5bd-41a8-b72b-e2511d488d61 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:42.489903 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-69f294a0-7e0e-49e1-959c-c257a53c409b req-dd44f5f9-e5bd-41a8-b72b-e2511d488d61 service nova] Creating event network-changed:1c2570cd-92fc-4346-a17c-e398ca95634d for instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 on hv-cinder-84330 Jul 20 09:13:42.503126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-69f294a0-7e0e-49e1-959c-c257a53c409b req-dd44f5f9-e5bd-41a8-b72b-e2511d488d61 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055650 Jul 20 09:13:42.503765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 70/137] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:43.331010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:43.332219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:43.343285 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:43.346523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:43.347546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:43.348815 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:43.761120 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:43.776508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c1f99b57-444e-4220-9a3d-f104ed6372d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.451375 Jul 20 09:13:43.778263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 68/138] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:43 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:44.488541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-17924ba7-d11e-4f4a-bd6f-a68e862e1752 req-33c8f41a-349e-4136-bc0a-22d60458c10c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:44.503523 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-17924ba7-d11e-4f4a-bd6f-a68e862e1752 req-33c8f41a-349e-4136-bc0a-22d60458c10c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:44.508540 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-17924ba7-d11e-4f4a-bd6f-a68e862e1752 req-33c8f41a-349e-4136-bc0a-22d60458c10c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:44.530391 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-17924ba7-d11e-4f4a-bd6f-a68e862e1752 req-33c8f41a-349e-4136-bc0a-22d60458c10c service nova] Creating event network-changed:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:13:44.536471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-17924ba7-d11e-4f4a-bd6f-a68e862e1752 req-33c8f41a-349e-4136-bc0a-22d60458c10c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056439 Jul 20 09:13:44.538012 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 71/139] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:44.797342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:44.798276 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:44.815037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:44.818134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:44.819988 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:44.821416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:44.874698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=100 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:45.119902 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:45.129415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f0a7e218-acf5-49e0-9611-c80880745583 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.336278 Jul 20 09:13:45.135002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 69/140] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:44 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:46.148273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:46.150302 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:46.156802 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:46.157527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:46.158499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:46.158967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:46.183230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:46.329020 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:46.338483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ce638cb3-501c-4976-91d0-f17b86205106 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.194933 Jul 20 09:13:46.348474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 72/141] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:46 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:47.356293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:47.356983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:47.359293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=88 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:47.365285 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:47.365956 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:47.367043 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:47.367991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:47.525058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:47.536757 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6c422a7c-2d82-47db-beea-58db0b48994f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.184845 Jul 20 09:13:47.545788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 70/142] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:47 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:48.555625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:48.556245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:48.563041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:48.563676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:48.564456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:48.564893 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:48.722910 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:48.732478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d8e4b9af-8a50-4670-ac83-377633f7eaf6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.182947 Jul 20 09:13:48.733248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 73/143] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:48 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:49.749860 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:49.750570 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:49.757148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:49.758512 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:49.759596 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:49.760031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:49.975400 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:49.983405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-27765954-f7c3-4d29-94f6-6eea48d85fc1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.237541 Jul 20 09:13:49.984768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 71/144] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:49 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:51.000779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:51.002154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:51.010067 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:51.010782 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:51.011884 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:51.012422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:51.168934 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:51.177214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9862525d-c45c-4da8-bb87-a1bdd8274d11 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.180160 Jul 20 09:13:51.187193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 74/145] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:50 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:52.195115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:52.196961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:52.203460 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:52.203911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:52.204693 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:52.205132 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:52.365814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:52.379151 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0d530890-95ad-42de-b09e-a21160ffc7dc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.188583 Jul 20 09:13:52.379920 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 72/146] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:52 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:53.400681 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:53.401322 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:53.403717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=70 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:13:53.413396 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:53.414416 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:53.415360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:53.415805 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:53.551572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:53.552226 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:53.562855 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:53.564071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:53.565592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:53.566533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:53.600446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:13:53.612533 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:53.620954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-31d0a43f-784f-4ef2-871c-65bad722e8df tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.227217 Jul 20 09:13:53.630119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 75/147] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:53 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:53.731376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9e2ff108-17d5-46ce-abcb-1a6b7f7b0e2c tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 204 len: 0 microversion: 2.1 time: 0.186339 Jul 20 09:13:53.732534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 73/148] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:13:53 2022] DELETE /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:13:53.741411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:53.742239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:53.749188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:53.750148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:53.751071 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:53.751782 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:54.122654 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:54.131931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fe89e06c-d2cc-47e6-bbbf-423bbf508484 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1555 microversion: 2.1 time: 0.395108 Jul 20 09:13:54.133411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 76/149] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:53 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1555 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:54.638363 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:54.639092 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:54.645599 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:54.646055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:54.646858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:54.647300 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:54.781779 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:54.790108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1984db8a-16d5-4bca-a1dd-4db93104d3ec tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.155759 Jul 20 09:13:54.790711 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 74/150] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:54 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:55.150804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:55.151343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:55.157935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:55.158386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:55.159190 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:55.159624 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:55.317755 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:55.330434 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a616801e-346a-4e6d-8671-50308fc41ff2 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1555 microversion: 2.1 time: 0.184808 Jul 20 09:13:55.331010 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 77/151] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:55 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1555 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:55.806899 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:55.807564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:55.813612 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:55.814067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:55.814861 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:55.815305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:55.939249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:55.947019 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8284028e-87aa-4b69-a759-34257ffe9b52 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.143952 Jul 20 09:13:55.947596 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 75/152] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:55 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:56.348345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:56.348956 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:56.355598 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:56.356049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:56.356804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:56.357238 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:56.486477 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:56.494822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9ae9d100-62b3-4f11-9329-511273aedf97 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1555 microversion: 2.1 time: 0.150310 Jul 20 09:13:56.495713 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 78/153] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:56 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:56.963451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:56.964161 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:56.970089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:56.970531 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:56.971324 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:56.971756 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:57.104659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:57.112038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c2d65730-d84a-4428-8a4b-bf75089a9685 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.152550 Jul 20 09:13:57.112610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 76/154] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:56 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:57.513126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:57.513972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:57.521138 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:57.521596 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:57.524519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:57.524988 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:57.665184 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:57.673186 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8d1fe1f8-7416-4845-bb11-8455f04a2502 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1555 microversion: 2.1 time: 0.164535 Jul 20 09:13:57.673757 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 79/155] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:57 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:58.130125 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:58.130897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:58.155368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:58.158106 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:58.162775 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:58.164974 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:58.448593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:58.459633 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-84ea2b85-4841-4275-aa8e-c09483a3178b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.333732 Jul 20 09:13:58.463100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 77/156] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:58 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:58.691513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:58.692314 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:58.706618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:58.707140 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:58.709477 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:58.710002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:58.715349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-dd8462fb-b4f7-4d39-a892-0378eb2e7a1b req-de885820-35d4-4ec9-a9e3-a20b22a1b913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06b84992-1120-4e6d-be2e-f66d530b5ed4", "name": "network-vif-deleted", "tag": "82fdf704-5224-44e3-afb6-ab44f9ffc40a"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:13:58.723797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-dd8462fb-b4f7-4d39-a892-0378eb2e7a1b req-de885820-35d4-4ec9-a9e3-a20b22a1b913 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:58.724713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-dd8462fb-b4f7-4d39-a892-0378eb2e7a1b req-de885820-35d4-4ec9-a9e3-a20b22a1b913 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:58.738663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-dd8462fb-b4f7-4d39-a892-0378eb2e7a1b req-de885820-35d4-4ec9-a9e3-a20b22a1b913 service nova] Creating event network-vif-deleted:82fdf704-5224-44e3-afb6-ab44f9ffc40a for instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 on hv-cinder-84330 Jul 20 09:13:58.745304 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-dd8462fb-b4f7-4d39-a892-0378eb2e7a1b req-de885820-35d4-4ec9-a9e3-a20b22a1b913 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035319 Jul 20 09:13:58.746073 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 78/157] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:13:58.792467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:58.803418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cdeedd9a-2a2b-48e8-80de-16d89e06aae8 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1513 microversion: 2.1 time: 0.115836 Jul 20 09:13:58.804339 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 80/158] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:58 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1513 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:59.483861 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:59.484677 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:59.499430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:59.499879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:59.500646 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:59.501085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:59.663235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:59.671860 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e80e840d-5818-4186-87d1-9a0fb7c3a205 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.194340 Jul 20 09:13:59.672440 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 79/159] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:59 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:13:59.821554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:13:59.822175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:13:59.828943 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:59.829393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:59.830165 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:13:59.830603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:13:59.897740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:13:59.906614 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6dae9821-b192-44fe-bf16-94b2e388949f tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1346 microversion: 2.1 time: 0.089763 Jul 20 09:13:59.907404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 81/160] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:13:59 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:00.690235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:00.690983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:00.698498 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:00.698979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:00.699771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:00.700204 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:00.830170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:00.839433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-02bd38b2-13d1-4449-8d0e-21e5af350a60 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.152877 Jul 20 09:14:00.839958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 80/161] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:00 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:00.924074 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:00.924974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:00.931623 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:00.932076 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:00.932846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:00.933280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:00.999379 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:01.007437 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-42e2013e-2f54-4aaf-bf5e-af5992812b1b tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1346 microversion: 2.1 time: 0.087126 Jul 20 09:14:01.008007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 82/162] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:00 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:01.856871 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:01.857783 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:01.866423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:01.867236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:01.868382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:01.869159 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:02.024330 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:02.025109 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:02.032723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:02.033303 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:02.034153 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:02.034835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:02.068555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:02.069102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:02.069627 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lazy-loading 'fault' on Instance uuid 06b84992-1120-4e6d-be2e-f66d530b5ed4 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:14:02.074471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:02.081909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e9b1b741-fd8a-4615-ab6f-5537599e6b5a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.229210 Jul 20 09:14:02.082474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 81/163] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:01 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:02.120708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a24a58daa8ed4d77a649a670cc358638', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e286919dacfc4db1a83308683c2a23ba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:02.128935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a58a618c-e09d-43ed-b76e-e5a2287d2ff1 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 200 len: 1351 microversion: 2.1 time: 0.109073 Jul 20 09:14:02.129506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 83/164] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:02 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:03.106724 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:03.109181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:03.119403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.122818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.122818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.122818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.143152 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1061279688", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "networks": [{"uuid": "00975c8f-7106-401c-9cb3-2f84ec944d4e"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:03.204867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] validate_networks() for [('00975c8f-7106-401c-9cb3-2f84ec944d4e', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:14:03.408290 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:03.417269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-143ab185-10bd-4f5d-91fb-31d2df6afbc9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.321110 Jul 20 09:14:03.417872 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 82/165] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:03 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:03.425875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:03.426479 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:03.446209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.446655 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.447461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.448630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.465859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] HTTP exception thrown: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Request method failure captured: Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 HTTP/1.1 Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cXpFMYynbZfEzlvzi1cZGWmy8T3B3TpO1XrwF8mgLY2PVL_7TfCNxjE-9uQXx8GT30NL8fwSRqdeHigrsx4dXpsRBIh9EzYACXjjWII6g8O-OPNoggaDNdTLaDd-ZpdMCASUTLqFpK_f4LOjjgOteU9MedCuVugxeIX2TnVzIzDBM Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:14:03.471408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: a24a58daa8ed4d77a649a670cc358638 Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.473005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '06b84992-1120-4e6d-be2e-f66d530b5ed4'} Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:14:03.473878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.475272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.476977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Returning 404 to user: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:14:03.476977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7f026d8b-b9f0-4ac7-a46b-48c5a240191a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 404 len: 111 microversion: 2.1 time: 0.053389 Jul 20 09:14:03.478881 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 83/166] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:03 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:14:03.589408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:03.590457 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:03.597369 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.597814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.598569 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.599026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.612052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] HTTP exception thrown: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Request method failure captured: Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4/os-volume_attachments HTTP/1.1 Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cXpFMYynbZfEzlvzi1cZGWmy8T3B3TpO1XrwF8mgLY2PVL_7TfCNxjE-9uQXx8GT30NL8fwSRqdeHigrsx4dXpsRBIh9EzYACXjjWII6g8O-OPNoggaDNdTLaDd-ZpdMCASUTLqFpK_f4LOjjgOteU9MedCuVugxeIX2TnVzIzDBM Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:14:03.614169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: a24a58daa8ed4d77a649a670cc358638 Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.615544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'server_id': '06b84992-1120-4e6d-be2e-f66d530b5ed4'} Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:14:03.616185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:03.618360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:03.619574 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Returning 404 to user: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:14:03.619574 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-be3d667b-46a2-462e-833c-2546ca6492b7 tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032481 Jul 20 09:14:03.619796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 84/167] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:14:03 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:14:03.830042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:14:03.830467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:14:03.831017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:14:03.831447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:14:03.831933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:14:03.842239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.842832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.843885 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:03.844397 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:03.885949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Getting quotas for project 05578c66d5b14af29cc0d860ed978fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:03.894616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Getting quotas for user 7fed4d6dad5b4a06ae84a26b2aab9850 and project 05578c66d5b14af29cc0d860ed978fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:03.907728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:14:03.910055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:14:03.970187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-863c6c2c-74e1-49a5-868b-496e15a12bf0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.829359 Jul 20 09:14:03.977406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 84/168] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:14:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:14:03.982459 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9ebc1cb0-6e39-4d32-9769-a84ee05e4a7f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:03.983113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9ebc1cb0-6e39-4d32-9769-a84ee05e4a7f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:04.050416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9ebc1cb0-6e39-4d32-9769-a84ee05e4a7f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:04.068475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9ebc1cb0-6e39-4d32-9769-a84ee05e4a7f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1219 microversion: 2.1 time: 0.090602 Jul 20 09:14:04.070655 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 85/169] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:03 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:04.435833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:04.437023 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:04.454827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:04.458768 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:04.462205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:04.463134 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:04.665605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:04.675270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bc2dbfd2-a5a5-40f9-8130-43167f73091a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.243847 Jul 20 09:14:04.676360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 85/170] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:04 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:04.853701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:04.854210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:04.860335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:04.860789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:04.861549 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:04.861997 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:04.876804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] HTTP exception thrown: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Request method failure captured: Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: DELETE /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 HTTP/1.1 Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cXpFMYynbZfEzlvzi1cZGWmy8T3B3TpO1XrwF8mgLY2PVL_7TfCNxjE-9uQXx8GT30NL8fwSRqdeHigrsx4dXpsRBIh9EzYACXjjWII6g8O-OPNoggaDNdTLaDd-ZpdMCASUTLqFpK_f4LOjjgOteU9MedCuVugxeIX2TnVzIzDBM Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:14:04.878333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: a24a58daa8ed4d77a649a670cc358638 Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.879727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '06b84992-1120-4e6d-be2e-f66d530b5ed4'} Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:14:04.880515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.881791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.884394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Returning 404 to user: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:14:04.885232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-740dd74f-a27d-4be1-b6a1-6d7d00eb1e6a tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "DELETE /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 404 len: 111 microversion: 2.1 time: 0.035597 Jul 20 09:14:04.888954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 86/171] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:14:04 2022] DELETE /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:14:04.894425 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:04.895115 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] [instance: 06b84992-1120-4e6d-be2e-f66d530b5ed4] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:04.901110 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:04.901565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:04.902500 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:04.902975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:04.917700 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] HTTP exception thrown: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Request method failure captured: Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 HTTP/1.1 Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cXpFMYynbZfEzlvzi1cZGWmy8T3B3TpO1XrwF8mgLY2PVL_7TfCNxjE-9uQXx8GT30NL8fwSRqdeHigrsx4dXpsRBIh9EzYACXjjWII6g8O-OPNoggaDNdTLaDd-ZpdMCASUTLqFpK_f4LOjjgOteU9MedCuVugxeIX2TnVzIzDBM Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:14:04.922281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e286919dacfc4db1a83308683c2a23ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: e286919dacfc4db1a83308683c2a23ba Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-DeleteServersTestJSON-1099932757 Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: a24a58daa8ed4d77a649a670cc358638 Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-DeleteServersTestJSON-1099932757-project Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.923467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '06b84992-1120-4e6d-be2e-f66d530b5ed4'} Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:14:04.924132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. Jul 20 09:14:04.925147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:14:04.926146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] Returning 404 to user: Instance 06b84992-1120-4e6d-be2e-f66d530b5ed4 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:14:04.926146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-68325981-8e34-4cbe-82ac-09b93b5c982e tempest-DeleteServersTestJSON-1099932757 tempest-DeleteServersTestJSON-1099932757-project] 10.222.0.44 "GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4" status: 404 len: 111 microversion: 2.1 time: 0.033594 Jul 20 09:14:04.926146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 86/172] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:04 2022] GET /compute/v2.1/servers/06b84992-1120-4e6d-be2e-f66d530b5ed4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:14:05.088915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:05.089839 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:05.096124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:05.096671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:05.097507 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:05.098170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:05.243865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:05.252256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-278adf09-5603-4d2f-852e-4e272273c6fb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1271 microversion: 2.1 time: 0.168225 Jul 20 09:14:05.254585 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 87/173] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:05 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1271 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:05.694270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:05.694930 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:05.708576 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:05.714032 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:05.716723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:05.717876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:05.977576 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:05.990319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9295c255-ec39-4a0e-bbba-dca623d2f8a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.300206 Jul 20 09:14:05.993055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 87/174] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:05 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:06.271338 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:06.273167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:06.281226 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:06.282034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:06.282862 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:06.283393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:06.288385 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:06.380825 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:06.391555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1ddea4fd-998d-495e-9c12-2c5f5c467d3c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1271 microversion: 2.1 time: 0.124194 Jul 20 09:14:06.392687 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 88/175] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:06 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:07.009346 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:07.010148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:07.016729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:07.017288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:07.018169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:07.018793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:07.188564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:07.198491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9ac360ee-a15b-4e08-9922-3f799427e7d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.192781 Jul 20 09:14:07.199270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 88/176] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:07 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:07.409666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:07.411012 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:07.418259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:07.418914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:07.420030 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:07.421260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:07.506222 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:07.516083 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-12758448-3eff-4a66-9a4a-60e275397a2c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1279 microversion: 2.1 time: 0.110389 Jul 20 09:14:07.517239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 89/177] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:07 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1279 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:08.216049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:08.216708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:08.235518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:08.235973 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:08.236761 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:08.237176 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:08.540064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:08.540821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:08.554411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:08.558038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:08.560579 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:08.561796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:08.564589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:08.566328 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:08.575219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f01a0ab1-eba5-4b8a-a169-fb4d2812d5ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.362907 Jul 20 09:14:08.588556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 89/178] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:08 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:08.743591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:08.763714 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a82d6955-a72d-4fb0-82df-ff0c95488dd7 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1277 microversion: 2.1 time: 0.226678 Jul 20 09:14:08.766315 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 90/179] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:08 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1277 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:09.602090 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:09.602904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:09.616259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:09.617852 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:09.620650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:09.621350 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:09.781966 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:09.783193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:09.793416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:09.795450 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:09.798545 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:09.801475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:10.175106 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:10.188810 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-eb3deb93-446f-4ca4-b43e-829592bc95aa tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.597426 Jul 20 09:14:10.189414 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 90/180] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:09 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:10.200957 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:10.216504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a9730fc1-258f-4424-bd80-003303fb013e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.438443 Jul 20 09:14:10.217154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 91/181] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:09 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:10.261248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-62be491b-f5ca-4d7d-9e8c-a403901b0f89 req-ed6b929d-6c97-4786-b9ee-87a66724ba0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b177b55b-1fcd-4a64-bce7-624b671b5e80", "tag": "4ebe2e71-fd96-42ab-a168-45b40f6660a5"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:10.274688 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-62be491b-f5ca-4d7d-9e8c-a403901b0f89 req-ed6b929d-6c97-4786-b9ee-87a66724ba0b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:10.275225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-62be491b-f5ca-4d7d-9e8c-a403901b0f89 req-ed6b929d-6c97-4786-b9ee-87a66724ba0b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:10.292406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-62be491b-f5ca-4d7d-9e8c-a403901b0f89 req-ed6b929d-6c97-4786-b9ee-87a66724ba0b service nova] Creating event network-changed:4ebe2e71-fd96-42ab-a168-45b40f6660a5 for instance b177b55b-1fcd-4a64-bce7-624b671b5e80 on hv-cinder-84330 Jul 20 09:14:10.300362 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-62be491b-f5ca-4d7d-9e8c-a403901b0f89 req-ed6b929d-6c97-4786-b9ee-87a66724ba0b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043360 Jul 20 09:14:10.301653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 91/182] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:11.205426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:11.206058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:11.212601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:11.213065 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:11.213850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:11.214291 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:11.234193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:11.235001 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:11.242523 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:11.243254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:11.246062 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:11.246842 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:11.422063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:11.430288 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6c8dd27c-8137-4e3b-8987-6945aa4edc15 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.228748 Jul 20 09:14:11.430910 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 92/183] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:11 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:11.451942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:11.459676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6ecca829-6e25-4d10-b1dd-cbb7bcfb68af tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.229907 Jul 20 09:14:11.461332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 92/184] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:11 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:12.448887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:12.450717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:12.458326 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:12.458885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:12.459835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:12.460444 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:12.477960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:12.479451 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:12.489123 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:12.489920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:12.491343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:12.492591 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:12.880013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:12.890548 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c5719c67-f7cc-42b6-8caf-c406fa493728 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.447097 Jul 20 09:14:12.891786 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 93/185] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:12 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:12.913001 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:12.920790 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-61e63cb6-280e-4a44-924b-340ea94e0337 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.447203 Jul 20 09:14:12.921552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 93/186] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:12 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:13.910219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:13.911147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:13.917652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:13.918193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:13.919356 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:13.919928 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:13.939175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:13.939788 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:13.942368 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:13.943074 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:13.956584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:13.959622 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:13.962294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:13.962943 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:14.064346 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:14.269276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:14.281261 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c149fad6-0e62-47cd-9afa-84632e62a7fa tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.346174 Jul 20 09:14:14.282510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 94/187] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:13 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:14.551364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:14.561703 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c7e065f7-4046-4538-ac92-e89b7a0e3bb4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.656770 Jul 20 09:14:14.562275 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 94/188] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:13 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:15.303417 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:15.304727 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:15.322237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:15.324094 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:15.325130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:15.325787 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:15.587533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:15.589075 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:15.599700 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:15.601820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:15.602893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:15.603787 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:15.650920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:15.667898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a3679cc8-0696-4251-a8bd-6f77041aa7e3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.369703 Jul 20 09:14:15.671569 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 95/189] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:15 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:16.097639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:16.111936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a44293eb-cdd0-42e7-866b-274b913dbe71 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.531236 Jul 20 09:14:16.113858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 95/190] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:15 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:16.688894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:16.690244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:16.702870 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:16.703585 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:16.704974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:16.705654 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:16.982428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:16.991738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2cb236ef-a643-4988-8991-7c732a748ea0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.306911 Jul 20 09:14:16.992590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 96/191] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:16 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:17.056478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-c1f6813e-cae0-4f70-a798-f613be977690 req-8caf58d6-6dbd-4002-a009-675b6c4337bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b177b55b-1fcd-4a64-bce7-624b671b5e80", "name": "network-vif-plugged", "status": "completed", "tag": "4ebe2e71-fd96-42ab-a168-45b40f6660a5"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:17.072663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c1f6813e-cae0-4f70-a798-f613be977690 req-8caf58d6-6dbd-4002-a009-675b6c4337bd service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:17.073962 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c1f6813e-cae0-4f70-a798-f613be977690 req-8caf58d6-6dbd-4002-a009-675b6c4337bd service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:17.086714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-c1f6813e-cae0-4f70-a798-f613be977690 req-8caf58d6-6dbd-4002-a009-675b6c4337bd service nova] Creating event network-vif-plugged:4ebe2e71-fd96-42ab-a168-45b40f6660a5 for instance b177b55b-1fcd-4a64-bce7-624b671b5e80 on hv-cinder-84330 Jul 20 09:14:17.094213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-c1f6813e-cae0-4f70-a798-f613be977690 req-8caf58d6-6dbd-4002-a009-675b6c4337bd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040871 Jul 20 09:14:17.097170 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 97/192] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:17.132996 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:17.133948 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:17.149738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:17.150450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:17.152143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:17.152587 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:17.188144 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e89e5868-ffe9-4e86-8ea0-962597cabd08 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: .version_select at 0x7fadafde6f70>, body: {"keypair": {"name": "tempest-keypair-149059309", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSotXcwbpALplwBt+DFzCFDrXMZYdBq/Jlp+L5uEc4Iou5bGmqzXNSn70bTo5NV2soLT9iaRzTLaw8XagduMo2wEAMEa1bTfwOakXS7vIL3T12FJlu3HCkoIRXpr3MCSQ=="}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:17.206837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-e89e5868-ffe9-4e86-8ea0-962597cabd08 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for project 6476016c570542d3b00f9ed1507655da. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:17.211481 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-e89e5868-ffe9-4e86-8ea0-962597cabd08 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for user 0a3ed8bea97e49628311cb45d48ca699 and project 6476016c570542d3b00f9ed1507655da. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:17.244438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e89e5868-ffe9-4e86-8ea0-962597cabd08 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.470546 Jul 20 09:14:17.250546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 96/193] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:14:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:14:17.346016 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:17.355719 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f8cf12ae-8d4c-4c44-b764-2755f1ffe64d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.227625 Jul 20 09:14:17.356508 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 98/194] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:17 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:18.013105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:18.018234 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:18.020601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:18.029213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:18.029676 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:18.030610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:18.031075 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:18.174520 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:18.183456 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4b735807-302e-41fa-ad54-066f3b745194 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.175548 Jul 20 09:14:18.184053 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 97/195] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:18 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:18.377393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:18.378016 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:18.385637 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:18.386330 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:18.387384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:18.387877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:18.560230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:18.568507 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-adc1084e-8643-4940-a36b-19430dda2cdd tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.194951 Jul 20 09:14:18.569711 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 99/196] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:18 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:18.970921 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-962571151", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf837b36-0fb7-4a6a-9845-400e75c9cec0"}], "security_groups": [{"name": "tempest-securitygroup--136158323"}], "key_name": "tempest-keypair-149059309", "user_data": "}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:19.077620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] validate_networks() for [('cf837b36-0fb7-4a6a-9845-400e75c9cec0', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:14:19.201965 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:19.202586 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:19.208708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:19.209475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:19.210668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:19.211505 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:19.436627 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:19.445907 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-60bb27b8-9c6b-4d46-aa04-521191f8448b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.248237 Jul 20 09:14:19.446489 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 100/197] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:19 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:19.573065 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:14:19.573752 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:14:19.574230 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:14:19.574641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:14:19.575275 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:14:19.588844 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:19.589427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:19.589546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:19.589939 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:19.590801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:19.591243 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:19.599291 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:19.602173 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:19.604181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:19.606081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:19.614467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for project 6476016c570542d3b00f9ed1507655da. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:19.620663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for user 0a3ed8bea97e49628311cb45d48ca699 and project 6476016c570542d3b00f9ed1507655da. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:19.634078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:14:19.637100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:14:19.711242 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4126723d-9147-46bb-a0cb-d75af4efafd4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.744609 Jul 20 09:14:19.712037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 98/198] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:14:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:14:19.726309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2e3f461a-b6df-433c-9f03-36ce8c0cc1b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:19.726990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2e3f461a-b6df-433c-9f03-36ce8c0cc1b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:19.824946 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2e3f461a-b6df-433c-9f03-36ce8c0cc1b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:19.838617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2e3f461a-b6df-433c-9f03-36ce8c0cc1b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1236 microversion: 2.1 time: 0.116867 Jul 20 09:14:19.849264 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 99/199] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:19 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1236 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:19.862916 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:19.871802 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9dd62a2f-fdcb-45c2-95b1-97b730502447 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1521 microversion: 2.1 time: 0.288199 Jul 20 09:14:19.872396 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 101/200] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:19 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:20.462993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:20.463867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:20.471235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:20.471920 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:20.472980 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:20.473687 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:20.626075 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:20.636248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2ec61f36-ad1a-4d86-bb28-000235c06e41 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.177270 Jul 20 09:14:20.637041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 100/201] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:20 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:20.856801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:20.858189 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:20.864733 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:20.865253 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:20.866887 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:20.867301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:20.888896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:20.889618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:20.901063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:20.901739 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:20.902593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:20.903136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:20.948750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:20.956720 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-451825cf-38b5-4a0a-80e7-f78942b3eb68 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1288 microversion: 2.1 time: 0.103771 Jul 20 09:14:20.967077 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 102/202] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:20 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1288 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:21.074105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:21.083229 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f24cf7aa-4b99-4a86-955b-08c5ba5cf89f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1501 microversion: 2.1 time: 0.198017 Jul 20 09:14:21.084020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 101/203] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:20 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1501 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:21.100069 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:21.101800 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:21.108070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:21.108533 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:21.109316 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:21.109926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:21.295551 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:21.303326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4950ff2b-7f08-42c2-872b-529e182a1a0f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1515 microversion: 2.1 time: 0.207412 Jul 20 09:14:21.305387 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 103/204] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:21 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1515 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:21.654125 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:21.655324 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:21.661610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:21.662056 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:21.663264 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:21.663829 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:21.810186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:21.817601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f5b49df5-0c66-4dd6-b8db-331602220ae8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1319 microversion: 2.1 time: 0.167480 Jul 20 09:14:21.818166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 102/205] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:21 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:21.973225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:21.973873 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:21.980749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:21.981213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:21.981994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:21.982418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:22.043898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:22.051169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-61b084bc-f99e-4e69-a0c3-c8ba2330719b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1296 microversion: 2.1 time: 0.081876 Jul 20 09:14:22.051732 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 104/206] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:21 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1296 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:22.680048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:22.681068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:22.687464 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:22.687923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:22.688722 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:22.689146 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:22.713870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'flavor' on Instance uuid 4b882a32-6794-4188-824a-7d2e1c061e67 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:14:22.831198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7f9d6aa2-721f-464c-87f2-1ef1f65698d3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/action" status: 200 len: 32 microversion: 2.1 time: 0.155507 Jul 20 09:14:22.836663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 103/207] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:14:22 2022] POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/action => generated 32 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 09:14:22.836860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:22.836860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:22.841989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:22.842447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:22.843412 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:22.844026 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:22.849709 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:22.851424 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:22.858141 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:22.858542 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:22.859435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:22.859877 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:23.256306 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:23.265253 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:23.266105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ce046a30-286e-47aa-a9fc-48c9e99a7b9b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1509 microversion: 2.1 time: 0.435312 Jul 20 09:14:23.266798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 105/208] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:22 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1509 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:23.273419 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3db67ffd-4e59-432a-ab99-a6e3708e8fce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.429021 Jul 20 09:14:23.274525 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 104/209] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:22 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:23.285417 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:23.286403 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:23.293989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:23.295291 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:23.296504 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:23.297023 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:23.483564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:23.497079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0d653401-ae00-4d37-bd96-4fed6ba72803 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.228846 Jul 20 09:14:23.497660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 106/210] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:23 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:24.271485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-9340f87a-14fc-4f21-a648-cb93427f0523 req-336b070a-7391-42d5-8329-8f13f61c8297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25fa365-3e8d-4bf5-8914-9ed484c6754a", "tag": "d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:24.294285 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:24.294841 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-9340f87a-14fc-4f21-a648-cb93427f0523 req-336b070a-7391-42d5-8329-8f13f61c8297 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:24.294841 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-9340f87a-14fc-4f21-a648-cb93427f0523 req-336b070a-7391-42d5-8329-8f13f61c8297 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:24.295877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:24.301953 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:24.303884 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:24.304475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:24.305389 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:24.305931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:24.328064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-9340f87a-14fc-4f21-a648-cb93427f0523 req-336b070a-7391-42d5-8329-8f13f61c8297 service nova] Creating event network-changed:d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab for instance e25fa365-3e8d-4bf5-8914-9ed484c6754a on hv-cinder-84330 Jul 20 09:14:24.347751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-9340f87a-14fc-4f21-a648-cb93427f0523 req-336b070a-7391-42d5-8329-8f13f61c8297 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068695 Jul 20 09:14:24.349608 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 105/211] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:24.486550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:24.490283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:24.496212 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-917a49b1-3989-48a2-8961-4da279c87033 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.208436 Jul 20 09:14:24.496789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 107/212] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:24 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:24.515443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:24.516150 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:24.522938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:24.523588 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:24.524545 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:24.525150 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:24.529454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:24.673459 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:24.681064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bf53e639-d228-46eb-8751-06e03bd3aea9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.169809 Jul 20 09:14:24.681649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 106/213] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:24 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:25.513557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:25.514690 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:25.521111 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:25.521564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:25.522333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:25.522826 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:25.667044 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:25.674617 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c98db27c-94de-4714-89b2-f69dcdc44985 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.165096 Jul 20 09:14:25.675217 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 108/214] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:25 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:25.697175 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:25.697792 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:25.704105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:25.704564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:25.705331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:25.705771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:25.846654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:25.855366 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c7ff685f-316b-4710-b305-d4d2c82e3d1e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.161888 Jul 20 09:14:25.855969 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 107/215] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:25 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:26.691437 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:26.692096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:26.698869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:26.699364 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:26.700079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:26.700514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:26.873343 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:26.874195 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:26.887501 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:26.888123 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:26.888938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:26.889375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:27.038325 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:27.045927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d14ff57f-84a2-4d1e-b6e1-c8f36de064f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.358489 Jul 20 09:14:27.046493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 109/216] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:26 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:27.066426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:27.074654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8b094876-c72d-49eb-83f7-945ea32895f5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.205117 Jul 20 09:14:27.075248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 108/217] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:26 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:28.062823 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:28.063440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:28.072151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:28.072625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:28.074395 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:28.074901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:28.091714 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:28.092587 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:28.099748 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:28.100886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:28.101745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:28.102243 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:28.296026 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:28.303667 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:28.306098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8344226b-538a-4d88-a480-a28e100efd69 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.246982 Jul 20 09:14:28.316758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 110/218] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:28 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:28.321668 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c972c409-c544-44b9-88b5-032cfe7b2d95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.233716 Jul 20 09:14:28.322248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 109/219] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:28 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:29.326582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:29.327294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:29.334095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:29.335248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:29.336305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:29.336808 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:29.339518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:29.340135 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:29.346587 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:29.348208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:29.349014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:29.349454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:29.538768 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:29.561816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:29.576430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-75e79c2a-170b-44f3-9bf4-2f9026bf5cd5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.241543 Jul 20 09:14:29.577108 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f1e7e66f-6ca9-48f7-a9ab-67d41af4b748 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.254551 Jul 20 09:14:29.577704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 111/220] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:29 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:29.579058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 110/221] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:29 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:29.673375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-31a832c9-c981-49b5-a45d-08b61cc1b862 req-f9465a57-84f3-41ef-8780-0b96601c4fbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25fa365-3e8d-4bf5-8914-9ed484c6754a", "name": "network-vif-plugged", "status": "completed", "tag": "d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:29.681927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-31a832c9-c981-49b5-a45d-08b61cc1b862 req-f9465a57-84f3-41ef-8780-0b96601c4fbd service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:29.682365 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-31a832c9-c981-49b5-a45d-08b61cc1b862 req-f9465a57-84f3-41ef-8780-0b96601c4fbd service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:29.693709 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-31a832c9-c981-49b5-a45d-08b61cc1b862 req-f9465a57-84f3-41ef-8780-0b96601c4fbd service nova] Creating event network-vif-plugged:d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab for instance e25fa365-3e8d-4bf5-8914-9ed484c6754a on hv-cinder-84330 Jul 20 09:14:29.699955 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-31a832c9-c981-49b5-a45d-08b61cc1b862 req-f9465a57-84f3-41ef-8780-0b96601c4fbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030198 Jul 20 09:14:29.700561 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 112/222] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:30.593739 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:30.594352 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:30.596211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:30.596584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:30.596961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=12 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:30.597294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:30.603054 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:30.603504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:30.603715 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:30.604175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:30.604278 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:30.604702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:30.604949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:30.605392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:30.800656 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:30.808038 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:30.809412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-33ef149a-76a5-40d2-a16d-b774ec39fa56 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.219647 Jul 20 09:14:30.809996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 111/223] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:30 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:30.815573 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e9eb295e-28f3-4647-bb68-db73661dc07c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1361 microversion: 2.1 time: 0.223754 Jul 20 09:14:30.816130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 113/224] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:30 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:31.826736 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:31.827497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:31.832887 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:31.833973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:31.835040 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:31.835951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:31.836280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:31.836485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:31.843923 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:31.844686 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:31.845540 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:31.846113 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:32.031586 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:32.039088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:32.041745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a0d76509-0400-4db9-8c79-2d3f04d4513e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.217679 Jul 20 09:14:32.041745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 112/225] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:31 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:32.048989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-47d6d9e1-2c04-4953-a25f-2fb652382da1 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1547 microversion: 2.1 time: 0.219914 Jul 20 09:14:32.049925 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 114/226] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:31 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:32.065932 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:32.066423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:32.072528 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:32.072973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:32.073987 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:32.074416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:32.154343 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b715a393-f65c-4b7b-ac69-abc93b86a213 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092204 Jul 20 09:14:32.155186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 113/227] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:14:32 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:33.058242 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:33.058857 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:33.065460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:33.065915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:33.066702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:33.067157 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:33.122796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-4c65d8d6-f9f0-43a7-9abb-996b904231d4 req-a19d6f31-ce68-423f-b893-c0e0fd2a60aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e25fa365-3e8d-4bf5-8914-9ed484c6754a", "tag": "d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:33.131303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4c65d8d6-f9f0-43a7-9abb-996b904231d4 req-a19d6f31-ce68-423f-b893-c0e0fd2a60aa service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:33.131824 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4c65d8d6-f9f0-43a7-9abb-996b904231d4 req-a19d6f31-ce68-423f-b893-c0e0fd2a60aa service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:33.145755 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-4c65d8d6-f9f0-43a7-9abb-996b904231d4 req-a19d6f31-ce68-423f-b893-c0e0fd2a60aa service nova] Creating event network-changed:d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab for instance e25fa365-3e8d-4bf5-8914-9ed484c6754a on hv-cinder-84330 Jul 20 09:14:33.154403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-4c65d8d6-f9f0-43a7-9abb-996b904231d4 req-a19d6f31-ce68-423f-b893-c0e0fd2a60aa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035228 Jul 20 09:14:33.155380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 114/228] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:14:33.233770 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:33.243255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7381cfd6-6c08-46cc-8a75-c2b27893f5b0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.189109 Jul 20 09:14:33.244666 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 115/229] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:33 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:34.261684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:34.262386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:34.268544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:34.269097 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:34.269949 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:34.270377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:34.418653 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:34.426273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-37452bf1-f67f-4d66-a35b-4c861c3766ef tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.168805 Jul 20 09:14:34.427187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 115/230] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:34 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:35.444544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:35.445172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:35.451999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:35.452448 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:35.453206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:35.453638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:35.589821 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:35.597255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-25cd649c-5895-4533-9529-bac1d5c9be4f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.156676 Jul 20 09:14:35.597820 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 116/231] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:35 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:36.615128 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:36.616005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:36.623452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:36.624017 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:36.624797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:36.625248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:36.764863 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:36.772690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-71c21038-6691-4685-af88-d744e42a44ed tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.161133 Jul 20 09:14:36.773263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 116/232] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:36 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:37.789837 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:37.790512 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:37.797119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:37.797565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:37.798413 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:37.798847 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:37.934433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:37.941856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-255384ab-e67c-4726-9ceb-3404babd29a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.156368 Jul 20 09:14:37.942427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 117/233] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:37 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:38.381423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:38.382085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:38.388143 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:38.388591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:38.389351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:38.389784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:38.417738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0e3fa81a-0fb9-4643-8529-c84be85ae802 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/ips" status: 200 len: 148 microversion: 2.1 time: 0.040364 Jul 20 09:14:38.418304 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 117/234] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:14:38 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/ips => generated 148 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:14:38.959430 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:38.960270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:38.966894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:38.967349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:38.968116 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:38.968672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:39.105612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:39.114130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6d279753-46a0-41f6-bd9b-b180dc81addc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.158913 Jul 20 09:14:39.115175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 118/235] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:38 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:39.780777 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a89d2580-3f8b-4289-8603-5db5044a5895"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:39.781842 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:39.788808 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:39.789261 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:39.790023 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:39.790462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:40.132759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:40.133420 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-366856e4-2451-4107-a1f5-703d57c5cba2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356453 Jul 20 09:14:40.133530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:40.134064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 118/236] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:14:39 2022] POST /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:40.144702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:40.145532 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:40.146393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:40.147699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:40.289271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:40.297480 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d8c15c16-71c5-4c7e-9101-22c9a5c725f0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.169061 Jul 20 09:14:40.298076 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 119/237] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:40 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:40.796234 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:40.796821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:40.803467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:40.803868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:40.804726 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:40.805108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:40.828622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-505e8853-d419-43da-8d18-8bffe7295830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/ips" status: 200 len: 152 microversion: 2.20 time: 0.037300 Jul 20 09:14:40.829214 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 119/238] 10.222.0.44 () {60 vars in 1288 bytes} [Wed Jul 20 09:14:40 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:14:41.314546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:41.315180 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:41.322419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:41.322946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:41.324121 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:41.324677 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:41.455853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:41.463988 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dd368c0e-bc57-4d25-be99-251723471db9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.153253 Jul 20 09:14:41.464552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 120/239] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:41 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:42.482026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:42.482636 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:42.489164 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:42.489610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:42.490450 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:42.491079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:42.633931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:42.641446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-feb28492-8623-4c35-bbaf-60b7f38cb521 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.163293 Jul 20 09:14:42.642020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 120/240] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:42 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:42.994384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:42.994992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:43.001412 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:43.001856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:43.002609 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:43.003071 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:43.033403 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lazy-loading 'flavor' on Instance uuid 7ce2565b-0061-4f06-950a-4941d97bdc2c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:14:43.303038 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0310fccc-d983-4184-8aa6-3026c3467cc3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/action" status: 202 len: 0 microversion: 2.20 time: 0.312477 Jul 20 09:14:43.303657 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 121/241] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jul 20 09:14:42 2022] POST /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:14:43.311937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:43.312724 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:43.320219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:43.320698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:43.321499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:43.321968 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:43.458420 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:43.466951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:43.468449 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:43.469590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a761fc54-e7d8-450d-ad67-ec62d1b2b9ea tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.161735 Jul 20 09:14:43.470147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 121/242] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:43 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:43.660014 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:43.660725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:43.667557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:43.668021 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:43.668827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:43.669270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:43.799492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:43.807242 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-69d5ca25-b47e-4ff6-87ec-ea0ab2fbdd7a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.151341 Jul 20 09:14:43.807742 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 122/243] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:43 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:44.487746 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:44.488380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:44.495533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:44.495979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:44.496734 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:44.497174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:44.627893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:44.636495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:44.637998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:44.639184 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-032790a6-a620-489d-b8db-0e8e0954f711 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.155379 Jul 20 09:14:44.639744 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 122/244] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:44 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:44.825436 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:44.826051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:44.832656 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:44.833105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:44.833862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:44.835043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:44.839320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:44.962571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:44.969959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b78aef63-2752-4432-80ad-bca2d79b551d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.149415 Jul 20 09:14:44.970525 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 123/245] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:44 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:45.657433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:45.658701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:45.665422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:45.668103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:45.668103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:45.668103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:45.672510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:45.811957 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:45.819991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:45.821520 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:45.822670 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-02308aef-d56a-48c8-a0a9-abf2ce0d9830 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.169297 Jul 20 09:14:45.823255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 123/246] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:45 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:45.987854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:45.988420 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:45.995130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:45.995585 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:45.996359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:45.996801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:46.122187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:46.129802 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-246297c0-a6da-4f17-be4f-faa6820d14ad tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.145967 Jul 20 09:14:46.130366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 124/247] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:45 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:46.841706 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:46.842313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:46.848814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:46.849259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:46.850834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:46.851262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:46.977588 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:46.985468 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:46.986997 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:46.988168 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-01ac90d8-68fa-470c-aaa2-c56a9381c686 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.150426 Jul 20 09:14:46.988734 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 124/248] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:46 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:47.146312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:47.147536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:47.154158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:47.154621 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:47.155438 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:47.155885 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:47.289958 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:47.297635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79084455-7cd5-4849-b5c5-68ff6e85259c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.155129 Jul 20 09:14:47.298202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 125/249] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:47 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:48.005197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:48.006490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:48.013428 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.013884 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.014657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.015117 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.144515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:48.152936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:48.154455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:48.155643 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6b35a127-ad99-43ae-8121-27bf1981d91c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.154319 Jul 20 09:14:48.156208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 125/250] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:48 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:48.314630 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:48.315303 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:48.322026 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.322475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.323329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.324072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.456541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:48.466445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-819ebabf-ecfe-4ecf-bce8-815e542d2fdc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1501 microversion: 2.1 time: 0.155481 Jul 20 09:14:48.467880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 126/251] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:48 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1501 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:48.485052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29b9292d-b54a-4e65-ac48-d9358e3664ff"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:48.486197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:48.488095 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:48.494001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.494454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.495251 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.495690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.519684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] HTTP exception thrown: Cannot 'attach_volume' instance 4b882a32-6794-4188-824a-7d2e1c061e67 while it is in vm_state rescued Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Request method failure captured: Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/os-volume_attachments HTTP/1.1 Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 74 Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cTzeJrq3428VCqYiBkjKlYLR1zNq4B-G31hq6v4Ubpf2ud4niPXu-UrRTnlDAooY5OoddW5uK03xMViJ0lsYc9LM6iAi2Kp1XuPGtl_ybGYmkAvc3E1-HPTkkAg_ELF2Y8fJOJmzRjKojOCuOV0KYZRcrJS1b8xKC0ElPOP3NEe0M Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:14:48.521986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: abdb339c5f5740d6aff4dfd1066f9384 Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {"volumeAttachment": {"volumeId": "29b9292d-b54a-4e65-ac48-d9358e3664ff"}} Jul 20 09:14:48.523618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Cannot 'attach_volume' instance 4b882a32-6794-4188-824a-7d2e1c061e67 while it is in vm_state rescued Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'server_id': '4b882a32-6794-4188-824a-7d2e1c061e67', 'body': {'volumeAttachment': {'volumeId': '29b9292d-b54a-4e65-ac48-d9358e3664ff'}}} Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:14:48.524476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4b882a32-6794-4188-824a-7d2e1c061e67 while it is in vm_state rescued Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:14:48.525774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4b882a32-6794-4188-824a-7d2e1c061e67 while it is in vm_state rescued Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Returning 409 to user: Cannot 'attach_volume' instance 4b882a32-6794-4188-824a-7d2e1c061e67 while it is in vm_state rescued {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2a39872a-f502-4b90-a349-327adc87a30a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042742 Jul 20 09:14:48.527057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 126/252] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:14:48 2022] POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 09:14:48.533113 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:48.533647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:48.539978 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.540428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.541193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.541628 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.612699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6dd0582d-af3c-46fe-b6c6-7b3218af35c5 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/action" status: 202 len: 0 microversion: 2.1 time: 0.082914 Jul 20 09:14:48.613698 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 127/253] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:14:48 2022] POST /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:14:48.621626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:48.622241 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:48.629636 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.630155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.632171 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:48.632680 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:48.703960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0506e052-2f39-4429-a860-f09609aba910 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: .version_select at 0x7fadbc7af310>, body: {"keypair": {"name": "tempest-keypair-1380901703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQQELLLHTGtdo5lTyckv3EUMh5O7tJ47VjVz2t1Y99O5ZuOsRESIRJlFtOC6n1OqvnVkN7sSIF4YE9xX4KOISUHi4JbRO6AC7KNjAY4XAz5Xo4Eaz/WPJZt/TKilAcl0A=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:48.726494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-0506e052-2f39-4429-a860-f09609aba910 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:48.730939 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-0506e052-2f39-4429-a860-f09609aba910 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:48.773273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:48.775779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0506e052-2f39-4429-a860-f09609aba910 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075933 Jul 20 09:14:48.781632 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 128/254] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:14:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:14:48.781812 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f69b8cb6-2d18-45ca-91de-389e77e4c84e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1509 microversion: 2.1 time: 0.163709 Jul 20 09:14:48.782255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 127/255] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:48 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:49.034552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "220a960d-5d57-427b-a4ac-a83f7d23bbc2", "device": "/dev/sdb"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:49.036276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:49.042597 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:49.043145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:49.043980 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:49.044483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:49.182857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:49.183462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:49.198187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:49.198913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:49.205968 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:49.206431 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:49.342354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bb4c0598-73a0-4226-9d4c-a9566e0ed1be tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "POST /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311812 Jul 20 09:14:49.343895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 129/256] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:14:49 2022] POST /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:14:49.436234 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:49.446286 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:49.447982 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:49.449420 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-fefc110a-86c7-4716-9398-ec75857898b5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.279406 Jul 20 09:14:49.460239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 128/257] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:49 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:14:49.800103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:49.801048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:49.809167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:49.809681 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:49.810493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:49.811055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:50.078548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:50.086045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f600a999-059d-4edb-acf8-ab513a68811c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1509 microversion: 2.1 time: 0.290804 Jul 20 09:14:50.086607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 130/258] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:49 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:50.468037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:50.469565 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:50.476589 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-179751919", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82594896-6626-4a61-89e5-7b2f2a36363e"}], "security_groups": [{"name": "tempest-securitygroup--1633604106"}], "key_name": "tempest-keypair-1380901703", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:50.477414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:50.477865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:50.478641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:50.479118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:50.628574 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] validate_networks() for [('82594896-6626-4a61-89e5-7b2f2a36363e', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:14:50.685656 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:50.694867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:50.696483 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:50.697638 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-34941ba1-3d82-4b9b-994b-986d087eb667 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.233434 Jul 20 09:14:50.698382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 129/259] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:50 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:51.039393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:14:51.040150 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:14:51.040633 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:14:51.041051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:14:51.041476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:14:51.050398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:51.050892 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:51.051701 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:51.052140 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:51.069759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:51.073955 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:51.085696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:14:51.088007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:14:51.103243 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:51.103843 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:51.109968 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:51.110414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:51.111205 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:51.111639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:51.134809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f31f04b2-3a4d-4c6b-8f04-f155ef224368 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.664129 Jul 20 09:14:51.135464 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 131/260] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:14:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:14:51.145370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fb9c539a-3253-44f7-b348-fdab9f1fac99 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:51.145999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fb9c539a-3253-44f7-b348-fdab9f1fac99 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:51.211329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fb9c539a-3253-44f7-b348-fdab9f1fac99 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:51.219013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fb9c539a-3253-44f7-b348-fdab9f1fac99 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1241 microversion: 2.1 time: 0.077322 Jul 20 09:14:51.219618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 132/261] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:51 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:51.405204 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:51.412984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b1108db1-b017-4d5a-b474-bf395cdb5454 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1509 microversion: 2.1 time: 0.313653 Jul 20 09:14:51.413558 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 130/262] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:51 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1509 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:51.715971 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:51.716591 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:51.722818 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:51.723273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:51.724042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:51.724979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:51.855281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:51.863429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:51.865094 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:51.867027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-92c26306-689a-4192-a1ee-fee64d061df6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.154934 Jul 20 09:14:51.867604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 133/263] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:51 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:52.237133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:52.237748 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:52.244945 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:52.245454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:52.246355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:52.246876 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:52.310456 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:52.319190 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4b946cbc-8c79-4a14-9b0a-3baabcf418e6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1293 microversion: 2.1 time: 0.085740 Jul 20 09:14:52.319871 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 131/264] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:52 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:52.433091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:52.433705 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:52.440115 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:52.440561 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:52.441329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:52.441766 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:52.786459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:52.794091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-01e2ae9c-56d2-4397-824c-d417231503b9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1515 microversion: 2.1 time: 0.365024 Jul 20 09:14:52.794658 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 134/265] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:52 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1515 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:52.886155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:52.886950 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:52.893114 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:52.893849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:52.894643 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:52.895117 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:53.080154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:53.091118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:53.092691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:53.094118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ca6f9441-350b-403d-9722-232242be8cec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.212216 Jul 20 09:14:53.105129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 132/266] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:52 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:53.336474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:53.337772 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:53.344060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:53.344506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:53.345272 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:53.345711 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:53.411743 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:53.419846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6478ce15-d581-4a53-b85c-1f6b89453e2a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1299 microversion: 2.1 time: 0.087513 Jul 20 09:14:53.420409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 135/267] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:53 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:54.112773 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:54.113568 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:54.121184 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:54.122295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:54.122612 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:54.127088 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:54.188220 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fa8ec29e-49ed-4aea-b31d-f8d8c44107b6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'create', calling method: .version_select at 0x7fadbc5e03a0>, body: {"keypair": {"name": "tempest-keypair-1760029009", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDj8xMZSP+Nq5wsdy9gM7GZz+Jm4S2SBkBozHyNn6JC/TOfVPck3b0pJRTrYbpEU6aSKnMGuFmld8Jk9C5UX4lq0dfB2dRIH3r7k/uc/09egN61YxEZXmDx1m8RZR3wHzA=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:54.208427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-fa8ec29e-49ed-4aea-b31d-f8d8c44107b6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:54.215452 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-fa8ec29e-49ed-4aea-b31d-f8d8c44107b6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for user abdb339c5f5740d6aff4dfd1066f9384 and project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:54.246850 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fa8ec29e-49ed-4aea-b31d-f8d8c44107b6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.063333 Jul 20 09:14:54.247571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 136/268] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:14:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:54.297005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-44595972-de92-434a-b52a-a32d30d76ed6 req-b2352c6f-c658-4f61-a2fe-9be44b036065 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d376e6-8b18-47e6-a0d3-d77f6b6e355f", "tag": "59c66212-d38f-49d8-8e6f-39ffe58317e2"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:54.330592 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-44595972-de92-434a-b52a-a32d30d76ed6 req-b2352c6f-c658-4f61-a2fe-9be44b036065 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:54.331677 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-44595972-de92-434a-b52a-a32d30d76ed6 req-b2352c6f-c658-4f61-a2fe-9be44b036065 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:54.333509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:54.343799 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:54.350066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:54.352198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3f889753-856c-4a92-a739-d4c1e60c03ad tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.243323 Jul 20 09:14:54.353236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 133/269] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:54 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:54.361108 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-44595972-de92-434a-b52a-a32d30d76ed6 req-b2352c6f-c658-4f61-a2fe-9be44b036065 service nova] Creating event network-changed:59c66212-d38f-49d8-8e6f-39ffe58317e2 for instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f on hv-cinder-84330 Jul 20 09:14:54.370653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-44595972-de92-434a-b52a-a32d30d76ed6 req-b2352c6f-c658-4f61-a2fe-9be44b036065 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080557 Jul 20 09:14:54.372444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 137/270] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:14:54.437113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:54.437767 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:54.446182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:54.446642 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:54.447448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:54.447886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:54.609562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:54.617740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f31bb18b-9be9-4a94-b5e2-fdc820bae383 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.184417 Jul 20 09:14:54.618421 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 134/271] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:54 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:55.373983 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:55.375005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:55.377005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:55.383398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:55.383859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:55.384654 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:55.385103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:55.523902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:55.533323 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:55.535284 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:55.537936 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-811edce2-2286-43b7-a7b3-43116ce8c172 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.169316 Jul 20 09:14:55.538635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 138/272] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:55 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:55.635693 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:55.636798 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:55.643533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:55.644265 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:55.645140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:55.645713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:55.824335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:55.833840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9e50796b-0278-43ca-88ef-d335272b21cc tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.202248 Jul 20 09:14:55.839744 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 135/273] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:55 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:55.906742 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-348707760", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b56ab455-e1e9-413d-bca3-4d8a7c9b346e"}], "security_groups": [{"name": "tempest-securitygroup--81949342"}], "key_name": "tempest-keypair-1760029009", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:56.036493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] validate_networks() for [('b56ab455-e1e9-413d-bca3-4d8a7c9b346e', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:14:56.475635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:14:56.476163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:14:56.476522 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:14:56.476929 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:14:56.477374 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:14:56.485984 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:56.486429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:56.487248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:56.487682 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:56.504834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:56.509096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Getting quotas for user abdb339c5f5740d6aff4dfd1066f9384 and project 19ee1fe6a5044166ba49d2a44e353f52. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:56.519987 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:14:56.522975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:14:56.556688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:56.558115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:56.564838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:56.565457 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:56.566404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:56.566879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:56.585225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6deb92b6-f7ba-446d-83b1-20fb4d442201 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.682629 Jul 20 09:14:56.590590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 139/274] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:14:55 2022] POST /compute/v2.1/servers => generated 407 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 20 09:14:56.597376 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a1b5869a-6dd5-4d78-882e-122d949318fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:56.598188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a1b5869a-6dd5-4d78-882e-122d949318fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:56.686751 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a1b5869a-6dd5-4d78-882e-122d949318fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:56.696065 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a1b5869a-6dd5-4d78-882e-122d949318fe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1245 microversion: 2.1 time: 0.103342 Jul 20 09:14:56.696660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 140/275] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:56 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1245 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:56.770932 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:56.780201 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:56.781961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:56.783172 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-56f4cd66-d9b9-4ece-beea-9b3a74ae4981 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.231076 Jul 20 09:14:56.784025 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 136/276] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:56 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:14:56.851630 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:56.852259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:56.863789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:56.864240 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:56.865079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:56.865664 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:57.050915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:57.059280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e4fc4c62-b78f-4aa5-a605-aec5592d1aa4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.212376 Jul 20 09:14:57.060053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 141/277] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:56 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:57.713312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:57.713954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:57.720868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:57.721329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:57.722230 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:57.722832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:57.785853 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:57.793979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e5eca898-2033-4d1a-b1f8-35686f606824 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1297 microversion: 2.1 time: 0.084552 Jul 20 09:14:57.794562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 137/278] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:57 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:57.801219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:57.801838 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:57.809008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:57.809465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:57.810236 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:57.810704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:57.948970 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:57.957508 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:57.960343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:57.961880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4b1e474c-6610-480f-ada4-414c4a3ec04f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.164406 Jul 20 09:14:57.963053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 142/279] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:57 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:14:58.077274 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:58.080113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:58.089776 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:58.090523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:58.091378 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:58.091823 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:58.274372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:58.284768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b3aa2a82-891b-4534-ad3b-869d7160a1b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.211676 Jul 20 09:14:58.294778 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 138/280] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:58 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:58.583856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2016418201", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:14:58.633579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] validate_networks() for None {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:14:58.811911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:58.813812 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:58.821332 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:58.821885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:58.822875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:58.823828 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:58.969214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:14:58.969694 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:14:58.970150 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:14:58.970571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:14:58.971210 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:14:58.982159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:58.982992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:58.983817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:58.984265 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:59.003860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Getting quotas for project c018eceac56a4a8b81e191303c36898a. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:14:59.008536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Getting quotas for user 864106cbb7754013bace02099b20d339 and project c018eceac56a4a8b81e191303c36898a. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:14:59.013526 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:59.020833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:14:59.022153 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7390df10-aba4-4cb4-a8db-0adb02f4cbe6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.214234 Jul 20 09:14:59.029622 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:14:59.030212 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 139/281] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:58 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:14:59.035990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:59.037608 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:59.044744 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:59.045340 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:59.046522 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:59.047136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:59.051847 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=100 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:59.071039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5700f436-adec-459d-b001-5382d2f772b5 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.490961 Jul 20 09:14:59.071790 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 143/282] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:14:59.081474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b2f74742-33db-448b-8b78-e60001fabee2 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:59.082086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b2f74742-33db-448b-8b78-e60001fabee2 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:59.152311 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2f74742-33db-448b-8b78-e60001fabee2 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:59.166863 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b2f74742-33db-448b-8b78-e60001fabee2 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1215 microversion: 2.1 time: 0.088789 Jul 20 09:14:59.167899 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 144/283] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:59 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:14:59.217158 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:59.226022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:59.227559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:59.228737 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ee88e986-88db-41a1-9bd6-307ed1787861 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.197122 Jul 20 09:14:59.229293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 140/284] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:14:59 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:14:59.302086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:14:59.303792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:14:59.309885 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:59.310336 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:59.312105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:14:59.312105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:14:59.316770 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:14:59.451374 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:14:59.460091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-01b7ce28-cd64-46fa-8caa-1ec4ec5709d4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.161804 Jul 20 09:14:59.460664 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 145/285] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:14:59 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:00.039183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:00.039794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:00.046192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.046638 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.047423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.047859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.175111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:00.183246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bf9dac02-2c08-4988-9ff5-7c7d334e8062 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.148461 Jul 20 09:15:00.183813 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 141/286] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:00 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:00.184367 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:00.184983 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:00.191519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.191966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.192730 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.193798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.249185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:00.249797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:00.256416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.256871 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.257662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.258089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.258668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:00.266596 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1523b369-aa3d-46ab-9f12-e13cc363ceee tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1219 microversion: 2.1 time: 0.086023 Jul 20 09:15:00.267210 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 146/287] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:00 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:00.387910 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:00.397929 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:00.399618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:00.401104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a8e7a4dd-428f-4722-a4db-f1fa92c7d69f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.155805 Jul 20 09:15:00.401670 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 142/288] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:00 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:00.477458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:00.478078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:00.484122 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.484581 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.485350 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:00.485791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:00.611538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:00.619115 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3b182a7d-76c4-46f9-b14e-6c54174e73bb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.146034 Jul 20 09:15:00.619685 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 147/289] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:00 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:01.200207 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:01.200845 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:01.207491 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.207938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.208906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.209344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.283577 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:01.284326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:01.291867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.292345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.293121 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.293560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.374210 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:01.380256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:01.388913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a35a7ab6-25f2-4371-8178-5e8e58c2c0b7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.192720 Jul 20 09:15:01.390150 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4e06f03d-3204-4bb3-9252-76a6aacc946e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1219 microversion: 2.1 time: 0.109291 Jul 20 09:15:01.390396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 143/290] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:01 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:01.395310 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 148/291] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:01 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:01.419105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:01.419822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:01.426113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.426732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.427601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.428050 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.572468 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:01.581796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:01.583461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:01.584649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0eead12b-f07c-4aa8-a716-17d87e2567f1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.169680 Jul 20 09:15:01.585233 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 144/292] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:01 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:01.636099 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:01.637182 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:01.644353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.644810 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.645586 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:01.646605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:01.792986 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:01.801014 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3944cacc-d05b-4c5e-9c62-1fe1a47c9da8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.168778 Jul 20 09:15:01.801556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 149/293] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:01 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:02.007529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-c49d3364-1ef9-4897-9d79-2c03a20c0946 req-0b496cf1-ab26-411b-ba88-4b704ad461a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75213b4-13b7-4a52-94ce-1b25a1f03daa", "tag": "65b22fc8-0bc5-46a4-a366-8f273ac5f7c6"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:02.016423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-c49d3364-1ef9-4897-9d79-2c03a20c0946 req-0b496cf1-ab26-411b-ba88-4b704ad461a1 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.017066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-c49d3364-1ef9-4897-9d79-2c03a20c0946 req-0b496cf1-ab26-411b-ba88-4b704ad461a1 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.029505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-c49d3364-1ef9-4897-9d79-2c03a20c0946 req-0b496cf1-ab26-411b-ba88-4b704ad461a1 service nova] Creating event network-changed:65b22fc8-0bc5-46a4-a366-8f273ac5f7c6 for instance d75213b4-13b7-4a52-94ce-1b25a1f03daa on hv-cinder-84330 Jul 20 09:15:02.034571 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-c49d3364-1ef9-4897-9d79-2c03a20c0946 req-0b496cf1-ab26-411b-ba88-4b704ad461a1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032101 Jul 20 09:15:02.035245 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 145/294] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:02.304846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-c8021be6-d6b0-4929-9b13-32234092e02a req-442c0148-62e1-437b-b51b-25b081bea9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d376e6-8b18-47e6-a0d3-d77f6b6e355f", "name": "network-vif-plugged", "status": "completed", "tag": "59c66212-d38f-49d8-8e6f-39ffe58317e2"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:02.316945 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c8021be6-d6b0-4929-9b13-32234092e02a req-442c0148-62e1-437b-b51b-25b081bea9c2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.317551 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-c8021be6-d6b0-4929-9b13-32234092e02a req-442c0148-62e1-437b-b51b-25b081bea9c2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.344730 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-c8021be6-d6b0-4929-9b13-32234092e02a req-442c0148-62e1-437b-b51b-25b081bea9c2 service nova] Creating event network-vif-plugged:59c66212-d38f-49d8-8e6f-39ffe58317e2 for instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f on hv-cinder-84330 Jul 20 09:15:02.354268 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-c8021be6-d6b0-4929-9b13-32234092e02a req-442c0148-62e1-437b-b51b-25b081bea9c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056145 Jul 20 09:15:02.355245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 150/295] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:02.408086 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:02.409098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:02.418443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:02.419460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:02.425330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.425970 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.427848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.428688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.429009 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.429492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.430444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.431178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.545369 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:02.555564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-768007f5-207b-4ad2-bbf6-96381cbd6d62 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1273 microversion: 2.1 time: 0.143767 Jul 20 09:15:02.557759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 151/296] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:02 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1273 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:02.608384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:02.609688 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:02.621066 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.623157 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.624174 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.624825 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.640885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:02.651344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2f10b488-c346-4064-a475-6223a47098ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.247883 Jul 20 09:15:02.651982 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 146/297] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:02 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:02.800070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:02.808907 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:02.810540 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:02.811858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ec6da107-f754-49f0-ad4a-82595d933e91 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1744 microversion: 2.20 time: 0.211325 Jul 20 09:15:02.812492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 152/298] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:02 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:02.820413 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:02.821297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:02.827715 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.828167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.829116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:02.829952 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:02.959923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:02.967853 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8e6d2dfd-4bdc-426c-adeb-5283490adafb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.154346 Jul 20 09:15:02.968447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 147/299] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:02 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:03.574167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:03.574850 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:03.581648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.582100 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.582950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.583437 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.648014 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:03.655592 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6c0f199b-3d88-4f5c-a481-88cd3e8b0eef tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1273 microversion: 2.1 time: 0.085540 Jul 20 09:15:03.656162 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 153/300] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:03 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:03.668626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:03.669238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:03.675820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.676266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.677043 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.677582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.806276 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:03.813647 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-65f10cba-2f08-4cfb-86e7-5fe4e14ff5cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.148794 Jul 20 09:15:03.814239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 148/301] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:03 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:03.830382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:03.831051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:03.837553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.838014 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.838805 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.839251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.966464 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:03.974938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:03.976462 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:03.977617 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c5dfa201-92f1-48ba-954c-13c3b225346c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1744 microversion: 2.20 time: 0.151180 Jul 20 09:15:03.978184 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 154/302] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:03 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:03.984883 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:03.985569 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:03.991763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.992211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:03.992964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:03.993394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:04.122888 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:04.130413 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0ec898a3-0a7b-406c-8f34-de710ab9c4a2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.149220 Jul 20 09:15:04.131033 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 149/303] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:03 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:04.672564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:04.673181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:04.680341 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:04.680795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:04.681559 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:04.681991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:04.744520 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:04.751847 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-93016d51-1afe-4f31-adbb-0325148b2211 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1273 microversion: 2.1 time: 0.083187 Jul 20 09:15:04.752404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 155/304] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:04 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:04.830282 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:04.830855 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:04.837795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:04.838246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:04.839032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:04.839471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:04.967205 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:04.975365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7ef5c7c3-3be8-4978-9913-176b17b53d1c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.148860 Jul 20 09:15:04.975934 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 150/305] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:04 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:04.995079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:04.995690 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:05.001664 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.002116 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:05.002912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.003354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:05.133419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:05.141964 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:05.143566 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:05.144771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d4db13ae-6d26-4c7d-b2ec-02afbe7e0dc9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1744 microversion: 2.20 time: 0.153705 Jul 20 09:15:05.145321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 156/306] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:04 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:05.147263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:05.147891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:05.154007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.154464 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:05.155265 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.155709 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:05.281328 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:05.289569 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e3848a8b-58ed-4bf1-ac19-7d1b25c1a62a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.146821 Jul 20 09:15:05.290134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 151/307] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:05 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:05.769479 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:05.770102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:05.777442 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.777897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:05.778713 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.779151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:05.846513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:05.854256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b4411b24-5960-49f5-b424-cf0a46908677 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1273 microversion: 2.1 time: 0.088655 Jul 20 09:15:05.854921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 157/308] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:05 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1273 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:05.992231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:05.992851 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:05.999325 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:05.999769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.000528 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.000962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.126309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:06.134193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d99db6b8-664f-4891-addb-2c796ec7ded6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.146032 Jul 20 09:15:06.134769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 152/309] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:05 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:06.163425 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:06.164030 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:06.169972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.170421 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.171215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.171648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.297819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:06.306457 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:06.307580 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:06.308017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:06.308221 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:06.309182 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-556e5192-d61d-478e-b19b-8f6234b16679 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1744 microversion: 2.20 time: 0.149641 Jul 20 09:15:06.309744 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 158/310] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:06 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:06.314136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.314590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.315396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.315837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.448210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:06.455790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b388a227-654a-4aa3-951c-e41d6d66ed17 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.151992 Jul 20 09:15:06.456362 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 153/311] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:06 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:06.872103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:06.872935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:06.881008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.881474 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.882319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:06.882868 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:06.952064 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:06.960304 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b46fd40b-ec9e-48b5-a866-43055c751df4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1273 microversion: 2.1 time: 0.092527 Jul 20 09:15:06.960877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 159/312] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:06 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1273 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:07.152195 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:07.153587 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:07.160260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.160743 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.161898 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.162349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.294279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:07.301782 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8a77b3f9-ac9d-4ebf-bdc6-600f0dc446d0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.154367 Jul 20 09:15:07.307741 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 154/313] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:07 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:07.328120 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:07.328736 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:07.334809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.335287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.336059 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.336494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.473561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:07.474494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:07.481938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.482716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.483591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.484225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.487476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:07.497128 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:07.498663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:07.500944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6777ed68-e1ab-4073-a82b-ce971a03d633 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1744 microversion: 2.20 time: 0.177016 Jul 20 09:15:07.501685 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 160/314] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:07 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1744 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:07.662111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:07.677433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0db74ff6-efd2-4afe-b515-3363a9dd338a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1367 microversion: 2.1 time: 0.207509 Jul 20 09:15:07.678713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 155/315] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:07 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:07.978775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:07.979714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:07.986614 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.988259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:07.992384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:07.993161 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.193690 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:08.201604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0c348ea2-eae1-4795-928c-1d10f3599cbd tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.227865 Jul 20 09:15:08.210732 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 161/316] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:07 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:08.320619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:08.321435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:08.335394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.335870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.336707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.337158 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.495741 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:08.511428 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b65884ff-4087-433d-b4ef-ae6a595c624a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.196053 Jul 20 09:15:08.512270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 156/317] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:08 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:08.519749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:08.521140 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:08.531500 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.532894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.534862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.540807 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.579764 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-56be31d4-d241-469f-9df0-36438acf913c req-9fc82d81-7e18-488e-b9ac-3eece5496ccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51eb07ce-4dea-4d42-8992-4820602e31f0", "tag": "cf5ec05b-0749-4fba-9f92-c44ab811c9c2"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:08.597287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:08.598389 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-56be31d4-d241-469f-9df0-36438acf913c req-9fc82d81-7e18-488e-b9ac-3eece5496ccd service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.599730 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-56be31d4-d241-469f-9df0-36438acf913c req-9fc82d81-7e18-488e-b9ac-3eece5496ccd service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.620695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-56be31d4-d241-469f-9df0-36438acf913c req-9fc82d81-7e18-488e-b9ac-3eece5496ccd service nova] Creating event network-changed:cf5ec05b-0749-4fba-9f92-c44ab811c9c2 for instance 51eb07ce-4dea-4d42-8992-4820602e31f0 on hv-cinder-84330 Jul 20 09:15:08.626767 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-56be31d4-d241-469f-9df0-36438acf913c req-9fc82d81-7e18-488e-b9ac-3eece5496ccd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051566 Jul 20 09:15:08.627841 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 157/318] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:15:08.698791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:08.699914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:08.717842 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.724030 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.728537 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.729236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.789165 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=100 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:08.918806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:08.927409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:08.929329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:08.930504 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-06112772-14e8-414b-bc1d-54b5f73e9aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.414676 Jul 20 09:15:08.931112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 162/319] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:08 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:08.945467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-01bb18e9-ebc0-4a6e-8ec7-8851a357cf1b req-c27d2cf1-5bc8-408f-81f6-58e4ca5f971f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "name": "network-vif-plugged", "status": "completed", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:08.954318 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-01bb18e9-ebc0-4a6e-8ec7-8851a357cf1b req-c27d2cf1-5bc8-408f-81f6-58e4ca5f971f service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:08.955074 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-01bb18e9-ebc0-4a6e-8ec7-8851a357cf1b req-c27d2cf1-5bc8-408f-81f6-58e4ca5f971f service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:08.969359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-01bb18e9-ebc0-4a6e-8ec7-8851a357cf1b req-c27d2cf1-5bc8-408f-81f6-58e4ca5f971f service nova] Creating event network-vif-plugged:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:15:08.975398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-01bb18e9-ebc0-4a6e-8ec7-8851a357cf1b req-c27d2cf1-5bc8-408f-81f6-58e4ca5f971f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035254 Jul 20 09:15:08.976567 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 163/320] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:09.007532 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:09.015097 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-899ddb6f-df5b-4d73-8bd2-dd48bcf02e1a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1556 microversion: 2.1 time: 0.323358 Jul 20 09:15:09.027404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 158/321] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:08 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1556 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:09.034904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:09.035496 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:09.039858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:09.044449 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.044908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.045699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.046137 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.137735 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7e92b841-1287-42ce-909d-0e9056c55bc0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108241 Jul 20 09:15:09.138331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 164/322] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:15:09 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:09.246733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:09.248059 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:09.267113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.274618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.275570 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.276026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.466554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:09.475496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-790a0cfd-d87a-43a9-9344-cdcc74e644c7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.258549 Jul 20 09:15:09.476467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 159/323] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:09 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:09.526011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=32 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:09.530342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:09.530986 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:09.546451 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.553175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.554610 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.555292 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.720801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:09.740135 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2d27a31f-ed6b-4485-81f5-059e9e551dd8 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.214300 Jul 20 09:15:09.741507 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 165/324] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:09 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:09.949653 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:09.950266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:09.961232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.961754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:09.962816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:09.963436 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:10.143431 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:10.153213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:10.154951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:10.156335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c7bcbb7a-8357-4d50-bbde-708e224ff5fc tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.210805 Jul 20 09:15:10.157462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 160/325] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:09 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:10.494028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:10.495707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:10.502820 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:10.503377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:10.504279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:10.504798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:10.671316 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:10.681335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-78f593f1-acff-4200-9958-a57a2e59a16b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.192195 Jul 20 09:15:10.690476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 166/326] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:10 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:10.721426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-37d1cebf-b3c7-430e-9e5a-d985fc9139bb req-52fdd376-5968-4f91-bc06-1a5197f2bae6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d376e6-8b18-47e6-a0d3-d77f6b6e355f", "tag": "59c66212-d38f-49d8-8e6f-39ffe58317e2"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:10.735669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-37d1cebf-b3c7-430e-9e5a-d985fc9139bb req-52fdd376-5968-4f91-bc06-1a5197f2bae6 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:10.738537 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-37d1cebf-b3c7-430e-9e5a-d985fc9139bb req-52fdd376-5968-4f91-bc06-1a5197f2bae6 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:10.757853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:10.758469 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:10.759015 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-37d1cebf-b3c7-430e-9e5a-d985fc9139bb req-52fdd376-5968-4f91-bc06-1a5197f2bae6 service nova] Creating event network-changed:59c66212-d38f-49d8-8e6f-39ffe58317e2 for instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f on hv-cinder-84330 Jul 20 09:15:10.765807 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:10.766255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:10.767064 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:10.768526 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-37d1cebf-b3c7-430e-9e5a-d985fc9139bb req-52fdd376-5968-4f91-bc06-1a5197f2bae6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051847 Jul 20 09:15:10.772409 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 161/327] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:10.772702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:10.958471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:10.966750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bc1e4a35-3bf3-4f3c-85fa-3b7e9e9044ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.213265 Jul 20 09:15:10.967370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 167/328] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:10 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:11.180573 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:11.181208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:11.190427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:11.190427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:11.190945 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:11.191648 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:11.385479 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:11.406270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:11.407994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:11.409334 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1dbcf1fa-e5fc-4c98-a3d3-659623297aec tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.235772 Jul 20 09:15:11.410345 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 162/329] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:11 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:11.699612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:11.702279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:11.718185 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:11.719180 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:11.720280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:11.721099 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:11.913210 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:11.925138 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1cb305bb-f34e-42af-947f-a9e57575d91f tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.230937 Jul 20 09:15:11.926088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 168/330] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:11 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:11.985149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:11.986447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:11.997029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:11.997490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:11.998313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:11.998771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:12.193483 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:12.203070 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-17bc3290-7a3d-4a65-824b-377cdfff72ae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.221653 Jul 20 09:15:12.216540 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 163/331] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:11 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:12.431015 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:12.431908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:12.443856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:12.444227 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:12.445046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:12.445482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:12.602163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:12.613172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:12.615550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:12.617142 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3028c73a-396e-4f2d-96e2-764ae5e3b953 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.192552 Jul 20 09:15:12.618155 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 169/332] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:12 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:12.943556 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:12.945169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:12.954698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:12.955437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:12.956311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:12.956880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:13.132337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:13.142531 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-81137fc3-8e65-408b-a983-13717a074d4d tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.203439 Jul 20 09:15:13.143217 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 164/333] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:12 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:13.224328 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:13.226306 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:13.233951 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:13.235113 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:13.236366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:13.237052 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:13.391501 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:13.399999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-16fa7671-662f-4dd0-a368-9621cefc2efc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.180592 Jul 20 09:15:13.409693 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 170/334] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:13 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:13.636538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:13.637188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:13.644055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:13.644744 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:13.646267 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:13.646738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:13.832489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:13.841459 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:13.843309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:13.844679 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b5d16d68-5984-4bb1-8331-ba4f275ad9ca tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.212079 Jul 20 09:15:13.845250 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 165/335] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:13 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:14.161657 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:14.162335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:14.164439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:14.172620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:14.173323 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:14.174112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:14.174557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:14.342786 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:14.351815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5e016ba0-7ae4-400d-acaf-038dd4fbd613 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.194232 Jul 20 09:15:14.353188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 171/336] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:14 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:14.417440 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:14.418223 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:14.424712 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:14.425171 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:14.425959 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:14.426402 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:14.590917 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:14.601706 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b36342ab-3df1-49ac-9b9e-a64dc83cb96c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.188154 Jul 20 09:15:14.605642 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 166/337] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:14 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:14.866119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:14.866750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:14.873223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:14.873672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:14.874448 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:14.874959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.050777 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:15.059385 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:15.061280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:15.062580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f761bca3-340b-435d-b360-dbfe56a3a463 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.201055 Jul 20 09:15:15.072416 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 172/338] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:14 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:15.369365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:15.369983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:15.377088 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:15.377958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.379375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:15.380440 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.539569 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:15.548964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c722ee6b-acaf-49e5-a9de-270a14eacbdf tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.183395 Jul 20 09:15:15.563664 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 167/339] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:15 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:15.621878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:15.622453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:15.629263 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:15.630331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.631859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:15.632537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.778473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:15.779129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:15.785840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:15.787708 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.788882 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:15.789544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:15.823293 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:15.835970 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-33acd840-f886-4dee-9197-da1de72d0bcf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.218034 Jul 20 09:15:15.846244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 173/340] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:15 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:15.946565 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lazy-loading 'services' on Instance uuid b177b55b-1fcd-4a64-bce7-624b671b5e80 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:15:16.082949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:16.083908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:16.094487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bb92fa46-7af0-4e92-9dc2-e2c92f10a22b tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80/os-volume_attachments/220a960d-5d57-427b-a4ac-a83f7d23bbc2" status: 202 len: 0 microversion: 2.1 time: 0.322826 Jul 20 09:15:16.100339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 168/341] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:15:15 2022] DELETE /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80/os-volume_attachments/220a960d-5d57-427b-a4ac-a83f7d23bbc2 => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:15:16.112867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.113396 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.117794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.118331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.563444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:16.575846 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:16.577218 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:16.587197 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:16.589374 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:16.592225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.593725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d4b6e542-1a0c-4c20-bd5a-6e2069ec080b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.515333 Jul 20 09:15:16.595365 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 174/342] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:16 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:16.599090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.600828 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.601599 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.753763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:16.762762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9d392d68-a157-461b-b4f0-8cb22139ef22 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.191673 Jul 20 09:15:16.763644 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 169/343] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:16 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:16.854591 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:16.855512 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:16.866446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-4145733b-d350-44ba-a81b-b8ce0eba0ac5 req-90f80af0-7c24-4576-bd1a-4a2f4fdb2f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75213b4-13b7-4a52-94ce-1b25a1f03daa", "name": "network-vif-plugged", "status": "completed", "tag": "65b22fc8-0bc5-46a4-a366-8f273ac5f7c6"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:16.887791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.888470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4145733b-d350-44ba-a81b-b8ce0eba0ac5 req-90f80af0-7c24-4576-bd1a-4a2f4fdb2f17 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.888753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.889061 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4145733b-d350-44ba-a81b-b8ce0eba0ac5 req-90f80af0-7c24-4576-bd1a-4a2f4fdb2f17 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.889911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:16.890536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:16.909516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-4145733b-d350-44ba-a81b-b8ce0eba0ac5 req-90f80af0-7c24-4576-bd1a-4a2f4fdb2f17 service nova] Creating event network-vif-plugged:65b22fc8-0bc5-46a4-a366-8f273ac5f7c6 for instance d75213b4-13b7-4a52-94ce-1b25a1f03daa on hv-cinder-84330 Jul 20 09:15:16.916949 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-4145733b-d350-44ba-a81b-b8ce0eba0ac5 req-90f80af0-7c24-4576-bd1a-4a2f4fdb2f17 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054858 Jul 20 09:15:16.918652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 170/344] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:15:17.075704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:17.087279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e890ce5d-2e66-42b7-936f-c5e0b4e5ebe2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.237356 Jul 20 09:15:17.103057 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 175/345] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:16 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:17.615552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:17.617003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:17.624956 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:17.625603 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:17.626405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:17.627085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:17.783375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:17.785164 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:17.793887 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:17.794691 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:17.795768 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:17.796698 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:17.807892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:17.816055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:17.817592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:17.818793 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bafee982-01a6-4bb6-a901-7bd554ca9299 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.208096 Jul 20 09:15:17.819362 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 171/346] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:17 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:17.962390 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:17.970309 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-747fc9c3-4d68-47a5-8ce7-2dd3b6bc07d8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.194389 Jul 20 09:15:17.986289 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 176/347] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:17 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:18.111972 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:18.112593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:18.119460 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.119917 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.120827 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.121273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.278529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:18.288535 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ac73d0fb-1527-43c2-8876-cafae735d8f6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.182621 Jul 20 09:15:18.298911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 172/348] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:18 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:18.360990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:18.361594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:18.369282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.369822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.370752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.371522 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.406770 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:15:18.512254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b8b46bde-1cf4-4371-9cf1-eeeafc7ddc6f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 204 len: 0 microversion: 2.1 time: 0.154334 Jul 20 09:15:18.512917 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 177/349] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:15:18 2022] DELETE /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:15:18.524493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:18.525105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:18.528032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=94 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:18.533682 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.534134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.535529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.535529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.688553 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:18.696602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-139c1ca6-4b6e-42df-b543-5463c4410b81 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1515 microversion: 2.1 time: 0.176783 Jul 20 09:15:18.697168 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 173/350] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:18 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1515 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:18.839294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:18.839909 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:18.846332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.847128 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.847953 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.848439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:18.869906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:18.988046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:18.989216 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:18.999115 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:18.999636 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:18.999880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.000666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:19.001103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.009215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:19.011158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:19.012399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2c9a9f8b-1a03-4224-994b-d36a5685c99e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.177792 Jul 20 09:15:19.026803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 178/351] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:18 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:19.091079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-53e4ffaf-a8ef-41ae-a618-d5a0a9b43dc4 req-93ac61ea-7ca5-455d-a4f9-681ec65c96e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eb07ce-4dea-4d42-8992-4820602e31f0", "name": "network-vif-plugged", "status": "completed", "tag": "cf5ec05b-0749-4fba-9f92-c44ab811c9c2"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:19.101702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-53e4ffaf-a8ef-41ae-a618-d5a0a9b43dc4 req-93ac61ea-7ca5-455d-a4f9-681ec65c96e2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:19.102143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-53e4ffaf-a8ef-41ae-a618-d5a0a9b43dc4 req-93ac61ea-7ca5-455d-a4f9-681ec65c96e2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.113553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-53e4ffaf-a8ef-41ae-a618-d5a0a9b43dc4 req-93ac61ea-7ca5-455d-a4f9-681ec65c96e2 service nova] Creating event network-vif-plugged:cf5ec05b-0749-4fba-9f92-c44ab811c9c2 for instance 51eb07ce-4dea-4d42-8992-4820602e31f0 on hv-cinder-84330 Jul 20 09:15:19.119843 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-53e4ffaf-a8ef-41ae-a618-d5a0a9b43dc4 req-93ac61ea-7ca5-455d-a4f9-681ec65c96e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038991 Jul 20 09:15:19.120803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 179/352] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:19.141412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:19.149369 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ec3c2936-bad7-4f7a-a0f0-a3323254e82a tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.165279 Jul 20 09:15:19.149994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 174/353] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:18 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:19.308190 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:19.308915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:19.315207 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:19.315651 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.316405 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:19.316837 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.453064 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:19.460476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7e0eef60-78f6-47ef-b28f-c50b6d9b2cf1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.156554 Jul 20 09:15:19.461036 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 180/354] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:19 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:19.713409 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:19.713950 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:19.720467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:19.720914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.721671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:19.722104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:19.740977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:19.853235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:19.860741 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1585e684-d3f5-4472-830f-8a2afe76fc55 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1515 microversion: 2.1 time: 0.151243 Jul 20 09:15:19.861305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 175/355] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:19 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:20.034503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:20.035062 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:20.041815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.042271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.043082 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.043525 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.166873 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:20.167492 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:20.171414 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:20.173678 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.174126 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.174925 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.175364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.180745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:20.182360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:20.183560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-54f55854-3e79-4e93-8c34-6e4dcc02b39a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.153095 Jul 20 09:15:20.184124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 181/356] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:20 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:20.308848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:20.316246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4d64789d-88a0-400a-947f-fefd21215f89 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.153262 Jul 20 09:15:20.316817 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 176/357] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:20 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:20.478028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:20.478619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:20.484896 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.485345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.486106 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.486541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.617650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:20.627965 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-27652b0b-8cc6-47ed-899a-3bc22bf13fe0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1369 microversion: 2.1 time: 0.154313 Jul 20 09:15:20.628538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 182/358] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:20 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:20.877338 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:20.877949 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:20.885129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.885576 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:20.886335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:20.886821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.021252 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:21.028581 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-25392e82-ebe5-4861-9339-b72119c66849 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1515 microversion: 2.1 time: 0.155148 Jul 20 09:15:21.029200 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 177/359] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:20 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:21.202025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:21.202954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:21.210162 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.210609 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.211397 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.211832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.332355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:21.333561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:21.339857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.340306 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.341078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.341213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:21.341517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.349365 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:21.350923 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:21.352116 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-53ba5831-1772-43fa-abef-911bc2aa4aa5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1739 microversion: 2.20 time: 0.154532 Jul 20 09:15:21.352704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 183/360] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:21 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:21.470331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:21.478255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-04ebfc83-8f90-4272-8188-928082f837a7 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.149809 Jul 20 09:15:21.478837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 178/361] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:21 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:21.646030 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:21.646738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:21.652899 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.653347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.654134 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.654569 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.793772 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:21.803225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-674e2183-3558-422f-9606-df24c169dc20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1563 microversion: 2.1 time: 0.160807 Jul 20 09:15:21.804137 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 184/362] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:21 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1563 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:21.820821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:21.821447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:21.828026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.828483 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.829263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:21.829707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:21.909292 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e6df7a59-685f-455a-9781-a20805480ebf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093590 Jul 20 09:15:21.910163 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 179/363] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:15:21 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:22.046226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:22.046891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:22.054279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.054794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.056087 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.056087 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.354322 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:22.370111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:22.371630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:22.376050 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d5e82c52-010a-4593-995c-ec58afe8c2eb tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1515 microversion: 2.1 time: 0.333585 Jul 20 09:15:22.376684 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 185/364] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:22 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1515 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:22.391032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.391538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.392339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.392769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.495635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:22.496684 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:22.503287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.503739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.504507 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.505146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.745799 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:22.755757 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:22.757495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:22.758727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c58301f2-7047-4505-b30c-7e461d638b19 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.392566 Jul 20 09:15:22.759302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 180/365] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:22 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:22.763790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-4148d16a-09ae-43d1-b19c-54a6b899c04f req-76dfbbc6-4b8c-4148-af50-b015f846acf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b177b55b-1fcd-4a64-bce7-624b671b5e80", "name": "network-vif-deleted", "tag": "4ebe2e71-fd96-42ab-a168-45b40f6660a5"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:22.772863 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4148d16a-09ae-43d1-b19c-54a6b899c04f req-76dfbbc6-4b8c-4148-af50-b015f846acf4 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:22.773307 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4148d16a-09ae-43d1-b19c-54a6b899c04f req-76dfbbc6-4b8c-4148-af50-b015f846acf4 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:22.780890 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:22.785505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-4148d16a-09ae-43d1-b19c-54a6b899c04f req-76dfbbc6-4b8c-4148-af50-b015f846acf4 service nova] Creating event network-vif-deleted:4ebe2e71-fd96-42ab-a168-45b40f6660a5 for instance b177b55b-1fcd-4a64-bce7-624b671b5e80 on hv-cinder-84330 Jul 20 09:15:22.789768 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-28ad5a1a-b913-4656-acca-ddd229a34dc4 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1315 microversion: 2.1 time: 0.297630 Jul 20 09:15:22.790366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 186/366] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:22 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:22.797907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-4148d16a-09ae-43d1-b19c-54a6b899c04f req-76dfbbc6-4b8c-4148-af50-b015f846acf4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Jul 20 09:15:22.797907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 181/367] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:23.136073 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-f6247e59-363b-49e1-9d45-8250624c6e4f req-9aee8530-abc9-42b8-9cbd-dc2bac273479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75213b4-13b7-4a52-94ce-1b25a1f03daa", "tag": "65b22fc8-0bc5-46a4-a366-8f273ac5f7c6"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:23.159814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f6247e59-363b-49e1-9d45-8250624c6e4f req-9aee8530-abc9-42b8-9cbd-dc2bac273479 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.160412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f6247e59-363b-49e1-9d45-8250624c6e4f req-9aee8530-abc9-42b8-9cbd-dc2bac273479 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.187055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-f6247e59-363b-49e1-9d45-8250624c6e4f req-9aee8530-abc9-42b8-9cbd-dc2bac273479 service nova] Creating event network-changed:65b22fc8-0bc5-46a4-a366-8f273ac5f7c6 for instance d75213b4-13b7-4a52-94ce-1b25a1f03daa on hv-cinder-84330 Jul 20 09:15:23.194033 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-f6247e59-363b-49e1-9d45-8250624c6e4f req-9aee8530-abc9-42b8-9cbd-dc2bac273479 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061147 Jul 20 09:15:23.195012 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 182/368] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:23.393491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:23.394106 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:23.401390 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.401844 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.402617 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.403128 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.434635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.435118 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.435607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lazy-loading 'fault' on Instance uuid b177b55b-1fcd-4a64-bce7-624b671b5e80 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:15:23.477547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:23.485021 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1f19bab2-9ead-4002-b169-d317975cc758 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1309 microversion: 2.1 time: 0.095428 Jul 20 09:15:23.485631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 187/369] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:23 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:23.778030 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:23.779031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:23.787550 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.788245 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.789553 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.789998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.805855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:23.806484 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:23.812568 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.813267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:23.814230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:23.814869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.011713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:24.015303 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:24.021108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:24.023930 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f0829a56-9acf-41d0-9772-0b2bdb7b6ba1 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1464 microversion: 2.1 time: 0.221871 Jul 20 09:15:24.024714 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:24.024844 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 188/370] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:23 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1464 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:24.025788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-04b5a09d-f035-444d-90a5-6d70591a366f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.252347 Jul 20 09:15:24.026590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 183/371] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:23 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:24.066759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:24.068019 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:24.074249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.074736 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.075527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.076669 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.101222 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:15:24.179862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e27c899b-15ee-41f2-89a9-76c8fcfe0dd0 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "DELETE /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 204 len: 0 microversion: 2.1 time: 0.117110 Jul 20 09:15:24.180445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 189/372] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:15:24 2022] DELETE /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:15:24.188729 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:24.189446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:24.198252 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.198993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.199774 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.200265 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.340581 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:24.348005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-940b6008-6bcd-45f6-8f00-f813786c8b4e tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1470 microversion: 2.1 time: 0.163204 Jul 20 09:15:24.348675 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 184/373] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:24 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:24.501998 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:24.502746 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:24.509636 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.510025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.510821 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.511263 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.545329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:24.545779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:24.546237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lazy-loading 'fault' on Instance uuid b177b55b-1fcd-4a64-bce7-624b671b5e80 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:15:24.587857 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:24.595345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2647450a-4404-4c10-81e9-d38303ac4688 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1309 microversion: 2.1 time: 0.097611 Jul 20 09:15:24.595913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 190/374] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:24 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:25.045473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:25.046269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:25.047673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-2da1591d-0673-4e6f-9916-3f34d8829ab0 req-78c00b10-5bbe-4c56-9746-242117babe66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "name": "network-vif-unplugged", "status": "completed", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:25.053716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.054252 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.055323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.055907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.056007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2da1591d-0673-4e6f-9916-3f34d8829ab0 req-78c00b10-5bbe-4c56-9746-242117babe66 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.056485 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2da1591d-0673-4e6f-9916-3f34d8829ab0 req-78c00b10-5bbe-4c56-9746-242117babe66 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.068794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-2da1591d-0673-4e6f-9916-3f34d8829ab0 req-78c00b10-5bbe-4c56-9746-242117babe66 service nova] Creating event network-vif-unplugged:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:15:25.073949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-2da1591d-0673-4e6f-9916-3f34d8829ab0 req-78c00b10-5bbe-4c56-9746-242117babe66 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029958 Jul 20 09:15:25.074917 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 191/375] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:25.189830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:25.198354 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:25.200163 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:25.201342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-36c1e44e-00b2-41f6-9cd5-207cf4a55a0a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.159850 Jul 20 09:15:25.201897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 185/376] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:25 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:25.365646 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:25.366349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:25.372833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.373320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.374317 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.374832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.505717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:25.513613 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f00a6d75-c714-4afa-95bd-6c8d7e7192b3 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1470 microversion: 2.1 time: 0.152858 Jul 20 09:15:25.514171 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 192/377] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:25 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:25.611955 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:25.612576 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:25.619266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.619754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.620524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.621206 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.652477 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:25.652931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:25.653390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lazy-loading 'fault' on Instance uuid b177b55b-1fcd-4a64-bce7-624b671b5e80 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:15:25.696508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:25.704294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4ae103bf-24eb-4977-b3c0-bd0ed5ad04b8 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 200 len: 1309 microversion: 2.1 time: 0.096173 Jul 20 09:15:25.704863 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 186/378] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:25 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:26.219668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:26.220288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:26.227904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:26.228358 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:26.229318 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:26.229754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:26.360552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:26.369154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:26.370660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:26.371830 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-59549785-829b-4666-8f87-afb15c50084e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.156250 Jul 20 09:15:26.372404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 193/379] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:26 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:26.530484 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:26.531046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:26.538126 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:26.538571 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:26.539369 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:26.539797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:26.669151 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:26.676602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4c2aeb47-4d6a-4352-b185-38ebb2217546 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1470 microversion: 2.1 time: 0.150024 Jul 20 09:15:26.677172 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 187/380] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:26 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:26.721383 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:26.722244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: b177b55b-1fcd-4a64-bce7-624b671b5e80] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:26.730410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:26.730925 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:26.731700 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:26.732143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:26.736167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:26.747559 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] HTTP exception thrown: Instance b177b55b-1fcd-4a64-bce7-624b671b5e80 could not be found. Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Request method failure captured: Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 HTTP/1.1 Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18dZtTiZdyxoZLB6a7SnO4WYXFJCqtnt3Mkp6xI5m3mCcMZwKgiUH8YvuveC2uyo3GTqWoNmmTJkySNUXKS83EHQqCOetcns9e4tdNDJW8WFFL8rtdKF9z8zAi87e7FUgwtDYOYJRXnoPU3fZsNgQRkLbEu_Wm8IVOJVMMNcOXDS56w Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 05578c66d5b14af29cc0d860ed978fbf Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1793011931 Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:15:26.749280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesSnapshotTestJSON-1793011931 Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 05578c66d5b14af29cc0d860ed978fbf Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1793011931 Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesSnapshotTestJSON-1793011931-project Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 7fed4d6dad5b4a06ae84a26b2aab9850 Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesSnapshotTestJSON-1793011931-project Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance b177b55b-1fcd-4a64-bce7-624b671b5e80 could not be found. Jul 20 09:15:26.750879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'b177b55b-1fcd-4a64-bce7-624b671b5e80'} Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b177b55b-1fcd-4a64-bce7-624b671b5e80 could not be found. Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:15:26.751919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b177b55b-1fcd-4a64-bce7-624b671b5e80 could not be found. Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b177b55b-1fcd-4a64-bce7-624b671b5e80 could not be found. Jul 20 09:15:26.753315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:15:26.755002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Returning 404 to user: Instance b177b55b-1fcd-4a64-bce7-624b671b5e80 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:15:26.755002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c8644703-96a2-409a-b4ce-15e1f6fe215a tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80" status: 404 len: 111 microversion: 2.1 time: 0.033272 Jul 20 09:15:26.755002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 194/381] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:26 2022] GET /compute/v2.1/servers/b177b55b-1fcd-4a64-bce7-624b671b5e80 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:15:27.389626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:27.390232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:27.397111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:27.397556 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:27.398319 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:27.398778 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:27.526416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:27.534338 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:27.535962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:27.537140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-355499f7-aa9a-4196-aea8-3af1634f1446 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.151743 Jul 20 09:15:27.537708 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 188/382] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:27 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:27.694001 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:27.694544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:27.701668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:27.702121 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:27.702915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:27.703351 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:27.836276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:27.843655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3e798bcd-2fd0-4345-94a5-2963a109ea5b tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1470 microversion: 2.1 time: 0.154244 Jul 20 09:15:27.844202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 195/383] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:27 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:28.555823 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:28.556438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:28.563409 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:28.563864 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:28.564626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:28.565061 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:28.699227 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:28.707298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:28.709640 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:28.710824 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a2027f90-0fbf-4a1a-aba0-d7dc74bfa49e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.159471 Jul 20 09:15:28.711373 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 189/384] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:28 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:28.860937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:28.861552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:28.868234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:28.868723 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:28.869503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:28.869944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:28.997908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:29.005920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e069889d-e9ee-4911-9f05-cb86fdfca7b8 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1470 microversion: 2.1 time: 0.148983 Jul 20 09:15:29.006477 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 196/385] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:28 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:29.729205 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:29.729810 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:29.736470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:29.736916 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:29.737676 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:29.738108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:29.871495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:29.880655 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:29.882176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:29.883389 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-633d4a37-be58-458f-999d-a3e159589ce7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1721 microversion: 2.20 time: 0.158103 Jul 20 09:15:29.884171 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 190/386] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:29 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:30.024475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:30.025117 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:30.032738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:30.033840 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:30.034664 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:30.035454 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:30.174456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:30.182472 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f2c2f81e-48ea-46dc-a085-8561dd38ec16 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1470 microversion: 2.1 time: 0.163013 Jul 20 09:15:30.183069 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 197/387] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:30 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:30.900599 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:30.901295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:30.907891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:30.908417 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:30.909249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:30.909750 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.047859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.058432 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.063400 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.066192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b7e29403-87a4-436e-bedc-6407bd451249 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1664 microversion: 2.20 time: 0.169476 Jul 20 09:15:31.070771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 191/388] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:30 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1664 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:31.094047 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "801dd605-77b1-4651-b938-a04451541016"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:31.095168 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:31.106149 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.106612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.107426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.107866 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.172725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-484f1597-6ba9-4220-9fe3-8f9b93b06449 req-c6eb55ce-309c-4c57-bc41-f70febc919fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51eb07ce-4dea-4d42-8992-4820602e31f0", "name": "network-vif-deleted", "tag": "cf5ec05b-0749-4fba-9f92-c44ab811c9c2"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:31.184557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-484f1597-6ba9-4220-9fe3-8f9b93b06449 req-c6eb55ce-309c-4c57-bc41-f70febc919fc service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.185620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-484f1597-6ba9-4220-9fe3-8f9b93b06449 req-c6eb55ce-309c-4c57-bc41-f70febc919fc service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.200847 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-484f1597-6ba9-4220-9fe3-8f9b93b06449 req-c6eb55ce-309c-4c57-bc41-f70febc919fc service nova] Creating event network-vif-deleted:cf5ec05b-0749-4fba-9f92-c44ab811c9c2 for instance 51eb07ce-4dea-4d42-8992-4820602e31f0 on hv-cinder-84330 Jul 20 09:15:31.217800 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-484f1597-6ba9-4220-9fe3-8f9b93b06449 req-c6eb55ce-309c-4c57-bc41-f70febc919fc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050861 Jul 20 09:15:31.231156 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 192/389] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:15:31.240716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:31.253585 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:31.268998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.269826 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.271456 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.272008 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.362092 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864106cbb7754013bace02099b20d339', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c018eceac56a4a8b81e191303c36898a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.373225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d3d8c79d-9cc6-4f86-9471-544ef826f377 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 200 len: 1300 microversion: 2.1 time: 0.138207 Jul 20 09:15:31.374360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 193/390] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:31 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 1300 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:31.481920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7be5b4fe-d899-4fd0-a8bf-cb1cfc18b464 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.394719 Jul 20 09:15:31.482583 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 198/391] 10.222.0.44 () {62 vars in 1363 bytes} [Wed Jul 20 09:15:31 2022] POST /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments => generated 188 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:15:31.604279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:31.604854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:31.610837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.611309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.612062 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.612496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.617186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=100 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:31.708149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-fc2e56ae-a80e-4f25-b309-71c299e9ff8c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/action" status: 202 len: 0 microversion: 2.20 time: 0.107170 Jul 20 09:15:31.709319 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 194/392] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jul 20 09:15:31 2022] POST /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:15:31.717378 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:31.718186 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:31.726671 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.727267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.728160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:31.728615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:31.883538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.892779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.894383 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:31.896259 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dc088e74-b7f4-42c2-877a-bf854f2c0420 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1750 microversion: 2.20 time: 0.182959 Jul 20 09:15:31.896908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 199/393] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:31 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:32.391556 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:32.392255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] [instance: 51eb07ce-4dea-4d42-8992-4820602e31f0] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:32.399684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:32.400141 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:32.400912 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:32.401346 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:32.416245 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] HTTP exception thrown: Instance 51eb07ce-4dea-4d42-8992-4820602e31f0 could not be found. Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Request method failure captured: Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 HTTP/1.1 Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18eRMQE_IzgoHPmBpB6jnm2c9iXkXwPJTDgPT4F8_BTvUAv8peiyTwX6F7FGO5ghId8qGyYqQNaSy8z4uD2s9I80Zbbhe07-NirTyeRfK6wA1SdnAN5cq5RUXOHeNeVPxuFRLNVS1k-eVRMxMYIBNn78Sx79g05ThFyVjzyJdInKWyw Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: c018eceac56a4a8b81e191303c36898a Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-VolumesNegativeTest-502907505 Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:15:32.418110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c018eceac56a4a8b81e191303c36898a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c018eceac56a4a8b81e191303c36898a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c018eceac56a4a8b81e191303c36898a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c018eceac56a4a8b81e191303c36898a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-VolumesNegativeTest-502907505 Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: c018eceac56a4a8b81e191303c36898a Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-VolumesNegativeTest-502907505 Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-VolumesNegativeTest-502907505-project Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 864106cbb7754013bace02099b20d339 Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-VolumesNegativeTest-502907505-project Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 51eb07ce-4dea-4d42-8992-4820602e31f0 could not be found. Jul 20 09:15:32.419466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '51eb07ce-4dea-4d42-8992-4820602e31f0'} Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51eb07ce-4dea-4d42-8992-4820602e31f0 could not be found. Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:15:32.421186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51eb07ce-4dea-4d42-8992-4820602e31f0 could not be found. Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51eb07ce-4dea-4d42-8992-4820602e31f0 could not be found. Jul 20 09:15:32.422527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:15:32.423976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] Returning 404 to user: Instance 51eb07ce-4dea-4d42-8992-4820602e31f0 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:15:32.423976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5bb3a287-ae1e-40ac-bccc-9998c2ea8c29 tempest-VolumesNegativeTest-502907505 tempest-VolumesNegativeTest-502907505-project] 10.222.0.44 "GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0" status: 404 len: 111 microversion: 2.1 time: 0.032100 Jul 20 09:15:32.423976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 195/394] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:32 2022] GET /compute/v2.1/servers/51eb07ce-4dea-4d42-8992-4820602e31f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:15:32.915291 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:32.916036 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:32.922722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:32.923178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:32.923941 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:32.924377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:33.060519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:33.071719 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:33.073446 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:33.075069 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cbe555b6-2f77-40c5-a8ba-fa58eadeba14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1752 microversion: 2.20 time: 0.164365 Jul 20 09:15:33.075718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 200/395] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:32 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:34.094495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:34.095802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:34.102902 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:34.103358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:34.104133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:34.104571 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:34.454969 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:34.464695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:34.466329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:34.467615 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4be201bf-311e-4177-a562-f59564d07492 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1752 microversion: 2.20 time: 0.377153 Jul 20 09:15:34.468246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 196/396] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:34 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1752 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:35.485582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:35.486196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:35.493619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:35.494067 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:35.495098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:35.495619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:35.625184 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:35.634205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:35.635739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:35.636883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-134b1e0d-4b3e-4e3e-8ea4-01f836be37e4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1752 microversion: 2.20 time: 0.155459 Jul 20 09:15:35.637431 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 201/397] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:35 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:35.793377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1067320095", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "networks": [{"uuid": "00975c8f-7106-401c-9cb3-2f84ec944d4e"}]}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:35.848652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] validate_networks() for [('00975c8f-7106-401c-9cb3-2f84ec944d4e', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:15:36.230804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:15:36.231236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:15:36.231717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:15:36.232128 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:15:36.232545 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:15:36.242185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:36.242638 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:36.243475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:36.243913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:36.262220 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Getting quotas for project 05578c66d5b14af29cc0d860ed978fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:15:36.266245 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Getting quotas for user 7fed4d6dad5b4a06ae84a26b2aab9850 and project 05578c66d5b14af29cc0d860ed978fbf. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:15:36.278071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:15:36.280502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:15:36.329406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9dceb5f7-8394-4c73-ab44-60e2ee4fb3ba tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539950 Jul 20 09:15:36.330066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 197/398] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:15:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:15:36.340227 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-234e3761-2bfe-45b4-add4-256112475ba6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:36.340846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-234e3761-2bfe-45b4-add4-256112475ba6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:36.417605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-234e3761-2bfe-45b4-add4-256112475ba6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:36.424345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-234e3761-2bfe-45b4-add4-256112475ba6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1219 microversion: 2.1 time: 0.087910 Jul 20 09:15:36.425437 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 202/399] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:36 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:36.656225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:36.657258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:36.664867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:36.665375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:36.666195 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:36.666619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:36.840406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:36.849911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:36.851875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:36.853593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7067a963-db6d-47b8-bc76-ccd14c762252 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.202387 Jul 20 09:15:36.854323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 198/400] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:36 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:37.442641 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:37.443892 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:37.451487 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:37.452158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:37.453443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:37.454047 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:37.539737 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:37.562713 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f496d1da-b97b-4c30-b45d-9e73b0cd2815 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1279 microversion: 2.1 time: 0.124359 Jul 20 09:15:37.567252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 203/401] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:37 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1279 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:37.873156 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:37.873782 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:37.881331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:37.881797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:37.889836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:37.890359 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:38.171666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:38.181831 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:38.183592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:38.184752 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9bf56085-e945-49fe-b8db-b5e8c1825eb9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.315895 Jul 20 09:15:38.185309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 199/402] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:37 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:38.585101 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:38.585727 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:38.592320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:38.592771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:38.593584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:38.593977 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:38.740392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:38.747932 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8c670ebe-38dc-4818-9c9a-39d270f85341 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.167260 Jul 20 09:15:38.748503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 204/403] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:38 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:39.203601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:39.204302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:39.212233 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:39.212615 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:39.213425 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:39.213861 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:39.353971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:39.362858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:39.365253 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:39.367048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9364b011-d080-4078-bbf1-001ba31beb2e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.167010 Jul 20 09:15:39.368032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 200/404] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:39 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:39.765578 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:39.766612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:39.774114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:39.774880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:39.776127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:39.776891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:39.918134 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:39.925571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e7dee0b3-5956-45a9-bec0-19bffe1a46dc tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.163931 Jul 20 09:15:39.926192 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 205/405] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:39 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:40.386325 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:40.387063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:40.393256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:40.393705 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:40.394495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:40.395768 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:40.527511 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:40.537084 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:40.538613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:40.539837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4d5db401-97af-4821-99e1-8a1122e4f575 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.157544 Jul 20 09:15:40.540396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 201/406] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:40 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:40.944000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:40.944857 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:40.952943 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:40.953502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:40.954382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:40.955002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:41.096523 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:41.104882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3856d644-fce0-49f4-a1bb-f5f9acc4c0df tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.165018 Jul 20 09:15:41.105451 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 206/407] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:40 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:41.211265 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:41.211680 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:41.217867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:41.218319 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:41.219127 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:41.219565 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:41.249624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-769159ec-4b40-45ef-a377-9457e814569f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/ips" status: 200 len: 145 microversion: 2.1 time: 0.042359 Jul 20 09:15:41.255177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 202/408] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:15:41 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:41.561168 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:41.561810 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:41.568207 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:41.568659 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:41.569510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:41.569951 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:41.710838 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:41.719254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:41.720796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:41.721977 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad9e618f-8edd-4574-b8c8-192406978faf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.164753 Jul 20 09:15:41.722536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 207/409] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:41 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:42.123290 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:42.124624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:42.132719 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:42.133174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:42.133957 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:42.134395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:42.277619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:42.286287 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bff4dee8-dcaf-4326-a880-70762c5060d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.166721 Jul 20 09:15:42.286899 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 203/410] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:42 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:42.741595 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:42.742293 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:42.750971 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:42.751424 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:42.752224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:42.752680 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:42.899224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:42.909176 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:42.912449 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:42.914062 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-86988712-d049-474d-9e0f-029700416fc5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.177098 Jul 20 09:15:42.915124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 208/411] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:42 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:43.304966 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:43.305583 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:43.312124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:43.312583 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:43.313350 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:43.313787 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:43.497769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:43.507620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-164dfde1-bf86-41b9-82b5-323054fdad11 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.207563 Jul 20 09:15:43.509301 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 204/412] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:43 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:43.575395 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "100e16fb-85e9-420b-a4d4-6c2ff9274cca"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:43.576518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:43.582798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:43.583252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:43.584028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:43.584471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:43.664906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:43.933003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:43.933606 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:43.939643 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:43.940092 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:43.940871 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:43.941303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:44.079422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:44.090958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:44.093110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:44.094759 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2b99dc7d-d26b-4819-b45f-571486a36419 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.165558 Jul 20 09:15:44.096516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 205/413] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:43 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:44.526464 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:44.528814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:44.535227 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:44.536163 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:44.536962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:44.537404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:44.671564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:44.679332 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4d88294d-4309-4b0c-8cc6-2196be44a654 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.157292 Jul 20 09:15:44.679907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 206/414] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:44 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:45.114958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:45.115573 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:45.121616 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:45.122064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:45.122857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:45.123298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:45.264485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:45.272962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:45.274475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:45.275661 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5e24bb64-9597-45b5-8203-6be25a937e7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.165348 Jul 20 09:15:45.276228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 207/415] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:45 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:45.696633 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:45.697384 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:45.703814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:45.704264 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:45.705039 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:45.705476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:45.844984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:45.853335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-435384e7-e364-4554-9ab7-a31ba0d1d105 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.160509 Jul 20 09:15:45.854108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 208/416] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:45 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:46.293427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:46.294038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:46.295917 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:46.296577 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:46.303272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:46.303731 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:46.304508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:46.304950 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:46.421869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:46.454912 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:46.470144 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:46.471690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:46.472884 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0214af7c-b910-4cda-89ed-fb0c21609d95 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.183363 Jul 20 09:15:46.473447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 209/417] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:46 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:46.870397 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:46.871090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:46.877620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:46.878102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:46.879004 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:46.879629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:47.019134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:47.027443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c7ff95dc-2ddc-4202-a222-850e4721f60e tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.160995 Jul 20 09:15:47.028009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 210/418] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:46 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:47.492376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:47.492986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:47.499052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:47.499505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:47.500269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:47.500705 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:47.519234 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:47.641166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:47.651455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:47.653007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:47.654180 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6f1f80e8-45e7-4ef7-81e3-579e0b78fff7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.166805 Jul 20 09:15:47.654822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 211/419] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:47 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:48.045666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:48.047026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:48.054699 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:48.055431 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:48.056204 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:48.056803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:48.191140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:48.199707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2a230143-85da-4b52-a0da-940498a28f84 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.158054 Jul 20 09:15:48.200278 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 212/420] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:48 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:48.675783 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:48.676675 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:48.678562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:48.684929 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:48.692427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:48.692427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:48.692427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:48.831886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:48.841962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:48.844080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:48.845406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9dbc0058-6cb3-4f5a-9236-1c7ad513f0d9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.173619 Jul 20 09:15:48.846252 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 213/421] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:48 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:49.217031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:49.217722 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:49.224817 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:49.225261 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:49.226093 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:49.226529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:49.361992 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:49.369956 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3fb4897c-dc4b-419c-ae1d-7a8ba9d9bee2 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.156802 Jul 20 09:15:49.370525 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 214/422] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:49 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:49.864572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:49.865191 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:49.871314 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:49.871770 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:49.872538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:49.872980 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:50.006095 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:50.014440 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:50.016011 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:50.017165 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-58df4bfc-8a8c-4670-86ef-d4de65ed5cf3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.156788 Jul 20 09:15:50.017740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 215/423] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:49 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:50.387269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:50.387949 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:50.395160 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:50.395611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:50.396361 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:50.396793 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:50.524812 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:50.532182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a1b58cfd-4ae0-4084-86ab-cbd5ad3607b4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.148741 Jul 20 09:15:50.532756 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 216/424] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:50 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:51.036761 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:51.037368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:51.043341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:51.043787 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:51.044545 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:51.044977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:51.185900 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:51.195010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:51.196510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:51.197778 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7e722e79-b7e6-4eb7-86aa-46c1597c1144 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.165730 Jul 20 09:15:51.198370 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 217/425] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:51 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:15:51.549055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:51.549816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:51.558612 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:51.559101 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:51.559923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:51.560367 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:51.691528 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:51.699312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1dcd355f-8960-4ad7-b8d9-dfa364e02fce tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.154342 Jul 20 09:15:51.700472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 218/426] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:51 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:51.704990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-faa5bb97-e74f-4eb3-ba78-5c01085e2e82 req-f4feda1f-48d1-4e7c-b2c4-63467e70ae69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f3de74-68ab-4abe-bb79-699e04c14a7c", "tag": "37e1b242-8f63-4b5a-8083-584fed55dfe1"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:51.712914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-faa5bb97-e74f-4eb3-ba78-5c01085e2e82 req-f4feda1f-48d1-4e7c-b2c4-63467e70ae69 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:51.713351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-faa5bb97-e74f-4eb3-ba78-5c01085e2e82 req-f4feda1f-48d1-4e7c-b2c4-63467e70ae69 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:51.724147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-faa5bb97-e74f-4eb3-ba78-5c01085e2e82 req-f4feda1f-48d1-4e7c-b2c4-63467e70ae69 service nova] Creating event network-changed:37e1b242-8f63-4b5a-8083-584fed55dfe1 for instance 61f3de74-68ab-4abe-bb79-699e04c14a7c on hv-cinder-84330 Jul 20 09:15:51.728988 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-faa5bb97-e74f-4eb3-ba78-5c01085e2e82 req-f4feda1f-48d1-4e7c-b2c4-63467e70ae69 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027412 Jul 20 09:15:51.729578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 219/427] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:51.886082 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8780de0b-bc96-4514-b0b0-e1023986db59 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.314383 Jul 20 09:15:51.886848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 209/428] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:15:43 2022] POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-volume_attachments => generated 194 bytes in 8316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:52.217524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:52.218436 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:52.225982 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:52.226438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:52.227416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:52.227848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:52.387570 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:52.397212 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:52.399071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:52.400547 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-112e69fb-de0a-4907-99d8-b3131d2e17a9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.187041 Jul 20 09:15:52.418273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 220/429] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:52 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:52.716918 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:52.717546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:52.724279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:52.729142 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:52.729596 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:52.730435 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:52.730922 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:52.891185 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:52.899784 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-76f7d900-90a7-4555-a801-7ac0bd3ba823 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.187192 Jul 20 09:15:52.900338 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 210/430] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:52 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:53.420229 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:53.420837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:53.427448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:53.427896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:53.428650 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:53.429089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:53.558444 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:53.567862 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:53.569421 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:53.570586 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-dd85e30a-bd5b-4897-9210-69f4d363ce9d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.154249 Jul 20 09:15:53.571208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 221/431] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:53 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:53.916797 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:53.917409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:53.923872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:53.924315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:53.925072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:53.926073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:54.060380 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:54.068162 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-01b7c913-2c2d-4803-b8e8-34c26d35d193 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.155164 Jul 20 09:15:54.068749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 211/432] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:53 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:54.589001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:54.589611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:54.596118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:54.596563 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:54.597318 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:54.597754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:54.726263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:54.734632 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:54.736235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:54.737372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2a2e8804-19a7-4a0d-bd4b-7f1d68dd63e3 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.152260 Jul 20 09:15:54.737973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 222/433] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:54 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:55.085859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:55.086489 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:55.093654 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:55.094139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:55.095020 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:55.095397 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:55.223881 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:55.231244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b7dbdc6a-058d-4e70-ac6c-91fd07e0c371 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.150143 Jul 20 09:15:55.231811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 212/434] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:55 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:55.756244 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:55.756868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:55.764489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:55.764946 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:55.765725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:55.766168 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:55.895868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:55.904311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:55.905838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:55.907032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9d075a24-53ba-42df-be54-9afcb018d039 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.155493 Jul 20 09:15:55.907591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 223/435] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:55 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:56.248623 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:56.249011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:56.257015 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:56.257633 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:56.258417 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:56.259036 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:56.392179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:56.400609 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0c4976fc-66f3-4d47-a1b7-7fa82daef68d tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.156550 Jul 20 09:15:56.401168 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 213/436] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:56 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:56.925461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:56.926336 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:56.933156 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:56.933644 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:56.934372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:56.934838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:57.068766 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:57.079551 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:57.081080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:57.083162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2f83041a-6fb2-403f-8739-fb2050a09f14 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.161498 Jul 20 09:15:57.083738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 224/437] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:56 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:57.417491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:57.418204 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:57.425045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:57.425580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:57.426430 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:57.427029 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:57.569290 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:57.577727 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-acdc4d31-9b90-4aaa-b28b-f883414ba608 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.164085 Jul 20 09:15:57.585817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 214/438] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:57 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:15:57.720471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-efdcd638-d95c-47f0-96b3-2d707f95b107 req-c0788448-397e-4789-98fb-85054376608e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f3de74-68ab-4abe-bb79-699e04c14a7c", "name": "network-vif-plugged", "status": "completed", "tag": "37e1b242-8f63-4b5a-8083-584fed55dfe1"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:57.735773 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-efdcd638-d95c-47f0-96b3-2d707f95b107 req-c0788448-397e-4789-98fb-85054376608e service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:57.736383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-efdcd638-d95c-47f0-96b3-2d707f95b107 req-c0788448-397e-4789-98fb-85054376608e service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:57.750800 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-efdcd638-d95c-47f0-96b3-2d707f95b107 req-c0788448-397e-4789-98fb-85054376608e service nova] Creating event network-vif-plugged:37e1b242-8f63-4b5a-8083-584fed55dfe1 for instance 61f3de74-68ab-4abe-bb79-699e04c14a7c on hv-cinder-84330 Jul 20 09:15:57.756393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-efdcd638-d95c-47f0-96b3-2d707f95b107 req-c0788448-397e-4789-98fb-85054376608e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045105 Jul 20 09:15:57.757416 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 225/439] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:15:58.101414 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:58.102027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:58.108095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:58.108550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:58.109317 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:58.109753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:58.241391 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:58.249806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:58.251436 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:58.252598 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-90588abb-118a-4b74-b0b7-3b19adbb50e2 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.155201 Jul 20 09:15:58.253160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 215/440] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:58 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:58.597860 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:58.598575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:58.605246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:58.605690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:58.606450 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:58.606913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:58.746048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:58.754369 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d396f13c-b349-499e-ace3-ee952c4f93e6 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.160882 Jul 20 09:15:58.755118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 226/441] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:58 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:59.272340 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:59.272960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:59.279531 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.279994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.280765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.281214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.403922 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-046a500c-561f-4165-bb1d-69a34d1fde7b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:15:59.409913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-046a500c-561f-4165-bb1d-69a34d1fde7b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.410365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-046a500c-561f-4165-bb1d-69a34d1fde7b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.417359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:59.426342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:59.427892 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:59.429056 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-989fd58c-7b4b-4ff4-ac95-b76441949adf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.161471 Jul 20 09:15:59.429620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 216/442] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:15:59 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:15:59.470933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-046a500c-561f-4165-bb1d-69a34d1fde7b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Going to try to stop instance {{(pid=117872) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 09:15:59.514662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-046a500c-561f-4165-bb1d-69a34d1fde7b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action" status: 202 len: 0 microversion: 2.1 time: 0.114424 Jul 20 09:15:59.515279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 227/443] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:15:59 2022] POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:15:59.523920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:59.524507 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:59.530446 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.530940 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.531705 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.532145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.665549 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:59.673622 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1558d728-57a1-40f3-af1f-0f84ebe110da tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.153647 Jul 20 09:15:59.674294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 217/444] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:59 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:15:59.772874 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:15:59.773591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:15:59.780879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.781333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.782112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:15:59.782554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:15:59.801102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:15:59.916215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:15:59.923564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d0894084-1dfa-4ed7-841e-2bd71617c90c tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1319 microversion: 2.1 time: 0.156063 Jul 20 09:15:59.924131 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 228/445] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:15:59 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:00.448194 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:00.449127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:00.455632 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:00.456087 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:00.456860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:00.457302 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:00.585822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:00.594514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:00.596057 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:00.597758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5530a261-ca9b-4883-abed-799e9bd7f1ee tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.153044 Jul 20 09:16:00.598394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 218/446] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:00 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:16:00.692127 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:00.692796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:00.699678 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:00.700136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:00.700921 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:00.701366 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:00.828840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:00.836921 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b2fb97f0-b9e4-4ee7-b319-17b9c4ab48aa tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.149150 Jul 20 09:16:00.837499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 229/447] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:00 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:00.940592 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:00.941312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:00.947386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:00.947782 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:00.948560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:00.949240 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.078759 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:01.087793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-676bbc36-6a63-458f-bfee-7bf52575e6d3 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1508 microversion: 2.1 time: 0.151103 Jul 20 09:16:01.088362 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 219/448] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:00 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:01.104879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6f8dbd1b-60f3-4304-98be-4df3b68fbd03", "device": "/dev/sdb"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:01.107075 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:01.117396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.117994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.118811 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.119256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.354705 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-309711e7-4d4c-48f6-a423-6f0d76546fa0 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "POST /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253492 Jul 20 09:16:01.355332 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 230/449] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:16:01 2022] POST /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:01.617340 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:01.618000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:01.624839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.625294 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.626067 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.626508 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.700527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-adc1c921-967b-4683-907f-07b59f870954 req-1ce3b4e4-c26f-446d-881c-c09986e986b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "name": "network-vif-plugged", "status": "completed", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:01.710352 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-adc1c921-967b-4683-907f-07b59f870954 req-1ce3b4e4-c26f-446d-881c-c09986e986b1 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.710831 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-adc1c921-967b-4683-907f-07b59f870954 req-1ce3b4e4-c26f-446d-881c-c09986e986b1 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.726745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-adc1c921-967b-4683-907f-07b59f870954 req-1ce3b4e4-c26f-446d-881c-c09986e986b1 service nova] Creating event network-vif-plugged:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:16:01.732688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-adc1c921-967b-4683-907f-07b59f870954 req-1ce3b4e4-c26f-446d-881c-c09986e986b1 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036566 Jul 20 09:16:01.733476 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 231/450] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:16:01.778377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:01.787590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:01.789247 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:01.790532 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b00ef3d5-0b09-43bc-b5e0-74fc460e055f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.178036 Jul 20 09:16:01.791126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 220/451] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:01 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:16:01.854394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:01.855162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:01.862122 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.862603 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.864083 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:01.864540 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:01.998077 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:02.006139 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-137d0212-318d-48b8-a7f5-ce537610da20 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.156016 Jul 20 09:16:02.006727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 232/452] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:01 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:02.808053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:02.808676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:02.815337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:02.816301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:02.817198 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:02.817657 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:02.946763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:02.955409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:02.957621 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:02.958812 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cf5d7c9e-f80d-45d4-ba4e-894c3b9d638b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.154712 Jul 20 09:16:02.959370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 221/453] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:02 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:16:03.023997 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:03.024609 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:03.031078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:03.031533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:03.032296 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:03.032736 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:03.169069 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:03.178016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-80485d2e-121a-4c47-a338-4fd78742e2d4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.158641 Jul 20 09:16:03.178593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 233/454] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:03 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:03.977299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:03.977992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:03.984825 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:03.985216 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:03.985964 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:03.986404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:04.126769 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:04.135991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:04.137501 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:04.138696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e12c5e9c-ce52-423e-ad8f-6357511ff3e9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1808 microversion: 2.20 time: 0.165427 Jul 20 09:16:04.139264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 222/455] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:03 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:16:04.194788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:04.195395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:04.201944 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:04.202391 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:04.203192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:04.203684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:04.337960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:04.346162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bb2f930b-7629-4e4d-9e84-1b5dad2ed328 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.155503 Jul 20 09:16:04.346600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 234/456] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:04 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:05.157552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:05.158156 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:05.165279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:05.165725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:05.166483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:05.166942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:05.297707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:05.306850 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:05.308355 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:05.309503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-519d654a-73da-4326-9c62-c6ccfe6e4dfd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1795 microversion: 2.20 time: 0.155846 Jul 20 09:16:05.310060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 223/457] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:05 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1795 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:16:05.364389 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:05.364997 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:05.371735 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:05.372185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:05.372945 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:05.373380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:05.500433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:05.508278 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ec80d363-ae8b-4067-9dbf-c0f6310e1067 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.148302 Jul 20 09:16:05.508838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 235/458] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:05 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:06.525034 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:06.525634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:06.532083 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:06.532531 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:06.533320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:06.533756 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:06.666416 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:06.674283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2bffe614-6363-4a2a-b97d-5fcc6ce9cf95 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.153076 Jul 20 09:16:06.674843 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 224/459] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:06 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:07.692911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:07.693423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:07.700292 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:07.700740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:07.701499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:07.701932 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:07.840842 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:07.849119 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-59662d4e-5459-492c-8558-0d6d6911417b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.160618 Jul 20 09:16:07.849765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 236/460] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:07 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:08.866076 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:08.866715 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:08.873125 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:08.873586 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:08.874360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:08.874848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:08.879649 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:09.009179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:09.017473 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ca56a8e4-cc2b-4bf8-ae86-60ba0495f773 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.155213 Jul 20 09:16:09.018046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 225/461] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:08 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:09.781104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:09.781655 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:09.788687 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:09.789135 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:09.790072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:09.790505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:09.813329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-47d1daf9-3359-4d8b-939c-a332c4d645df tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/ips" status: 200 len: 148 microversion: 2.1 time: 0.036000 Jul 20 09:16:09.813814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 237/462] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:16:09 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:09.824544 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a89d2580-3f8b-4289-8603-5db5044a5895"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:09.825683 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:09.832143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:09.832592 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:09.833358 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:09.833798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:09.913149 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Invalid volume: volume a89d2580-3f8b-4289-8603-5db5044a5895 is already attached to instances: ec129daf-9e04-4ed9-bd69-a27ebf04ed38 Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: POST /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/os-volume_attachments HTTP/1.1 Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 74 Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:16:09.914872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {"volumeAttachment": {"volumeId": "a89d2580-3f8b-4289-8603-5db5044a5895"}} Jul 20 09:16:09.916537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Invalid volume: volume a89d2580-3f8b-4289-8603-5db5044a5895 is already attached to instances: ec129daf-9e04-4ed9-bd69-a27ebf04ed38 Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'server_id': 'e7d376e6-8b18-47e6-a0d3-d77f6b6e355f', 'body': {'volumeAttachment': {'volumeId': 'a89d2580-3f8b-4289-8603-5db5044a5895'}}} Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a89d2580-3f8b-4289-8603-5db5044a5895 is already attached to instances: ec129daf-9e04-4ed9-bd69-a27ebf04ed38 Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:09.917422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a89d2580-3f8b-4289-8603-5db5044a5895 is already attached to instances: ec129daf-9e04-4ed9-bd69-a27ebf04ed38 Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:09.918862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a89d2580-3f8b-4289-8603-5db5044a5895 is already attached to instances: ec129daf-9e04-4ed9-bd69-a27ebf04ed38 Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 400 to user: Invalid volume: volume a89d2580-3f8b-4289-8603-5db5044a5895 is already attached to instances: ec129daf-9e04-4ed9-bd69-a27ebf04ed38 {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f2e8ff77-ba23-4343-aad0-9ecafd60cc76 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096054 Jul 20 09:16:09.920345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 226/463] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:16:09 2022] POST /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:16:09.925668 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:09.926212 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:09.932294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:09.932746 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:09.933509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:09.933946 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:09.959575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:16:10.036704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:10.037335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:10.037789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6ebcc636-703f-4f2d-aef4-bd3cd4cca057 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 204 len: 0 microversion: 2.1 time: 0.116032 Jul 20 09:16:10.038521 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 238/464] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:16:09 2022] DELETE /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:16:10.044615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:10.045071 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:10.045858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:10.046305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:10.046817 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:10.047531 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:10.053755 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:10.054213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:10.055015 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:10.055454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:10.239710 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:10.242992 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:10.247804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3dc9c580-aa56-4315-8e0c-b10427d40744 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.216524 Jul 20 09:16:10.248381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 227/465] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:10 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:10.250940 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bd6eca38-8f28-4071-a565-f4c8a221326c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.208085 Jul 20 09:16:10.251603 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 239/466] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:10 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:11.264648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:11.265210 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:11.269028 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:11.269894 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:11.272141 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:11.272605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:11.273393 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:11.273839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:11.276281 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:11.276736 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:11.277503 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:11.277942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:11.471539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:11.475452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:11.480519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-493394cb-f0b3-490a-a59f-54067d8adf28 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.219789 Jul 20 09:16:11.481102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 228/467] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:11 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:11.482822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-949d3d13-512a-446e-8a76-ea4e573a8ac0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.217565 Jul 20 09:16:11.483383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 240/468] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:11 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:12.498193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:12.498824 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:12.500703 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:12.501324 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:12.506831 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:12.507325 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:12.508095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:12.508437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:12.508539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:12.508894 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:12.509673 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:12.510114 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:12.694892 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:12.703276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-015cb1b6-00c1-44d4-9089-cbc3ba03777d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.208801 Jul 20 09:16:12.703734 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 229/469] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:12 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:12.705857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:12.713574 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9879587f-9262-4f35-a0b1-0dae6056790f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.216650 Jul 20 09:16:12.714142 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 241/470] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:12 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:13.719354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:13.719972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:13.726941 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:13.727428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:13.728210 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:13.728656 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:13.731516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:13.732137 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:13.739171 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:13.739630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:13.740407 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:13.740852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:13.929049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:13.933266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:13.937027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ac0fb647-aa7f-4ad6-9792-0611c4a07c6c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.221457 Jul 20 09:16:13.937589 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 230/471] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:13 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:13.941707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4dc72ecc-336c-459a-95c1-a34c1dfcedc4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.213981 Jul 20 09:16:13.942362 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 242/472] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:13 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:14.960596 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:14.961239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:14.961239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:14.961690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:14.967728 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:14.967876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:14.968216 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:14.968323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:14.968989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:14.969098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:14.969418 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:14.969521 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:14.973833 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:15.162358 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:15.168866 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:15.170444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-05885a9a-fbf7-4cd3-9465-02c449f78e03 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.214434 Jul 20 09:16:15.171044 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 231/473] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:14 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:15.177004 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4f1f111d-e3c5-4641-bd2f-d751f8802806 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.220981 Jul 20 09:16:15.177567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 243/474] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:14 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:16.188054 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:16.188683 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:16.193379 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:16.193998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:16.195752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:16.196209 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:16.196979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:16.197424 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:16.200889 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:16.201348 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:16.202123 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:16.202562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:16.396502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:16.399591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:16.404459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c42dadce-97fb-407f-b87c-2dcb54de70b4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.220374 Jul 20 09:16:16.407546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 232/475] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:16 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:16.407693 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3f46399c-bd6c-4cb9-8a15-e0891c4f98b4 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.217577 Jul 20 09:16:16.407693 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 244/476] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:16 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:17.426883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:17.426883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:17.432792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:17.433249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:17.435298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:17.435915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:17.439424 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:17.443270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:17.443719 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:17.444495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:17.444938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:17.449427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:17.666040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:17.671026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:17.674201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5a3e6dbf-b065-4314-97dc-ebc59e1ca79f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.256667 Jul 20 09:16:17.675535 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 233/477] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:17 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:17.681963 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e43b7039-a8fb-4fb3-aaef-4f8c8ac3c2e2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 200 len: 1680 microversion: 2.1 time: 0.260768 Jul 20 09:16:17.686011 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 245/478] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:17 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 1680 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:17.985435 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-3268ab32-98d2-4f12-8343-97e2754a9a1c req-48031b7d-dff1-4c07-a88d-97130e624646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d376e6-8b18-47e6-a0d3-d77f6b6e355f", "name": "network-vif-deleted", "tag": "59c66212-d38f-49d8-8e6f-39ffe58317e2"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:17.995276 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-3268ab32-98d2-4f12-8343-97e2754a9a1c req-48031b7d-dff1-4c07-a88d-97130e624646 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:17.995963 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-3268ab32-98d2-4f12-8343-97e2754a9a1c req-48031b7d-dff1-4c07-a88d-97130e624646 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:18.008503 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-3268ab32-98d2-4f12-8343-97e2754a9a1c req-48031b7d-dff1-4c07-a88d-97130e624646 service nova] Creating event network-vif-deleted:59c66212-d38f-49d8-8e6f-39ffe58317e2 for instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f on hv-cinder-84330 Jul 20 09:16:18.013905 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-3268ab32-98d2-4f12-8343-97e2754a9a1c req-48031b7d-dff1-4c07-a88d-97130e624646 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032078 Jul 20 09:16:18.015138 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 234/479] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:18.626151 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26f25154-baf4-4a58-873d-75f4f17f22fe"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:18.627365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:18.634488 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:18.635068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:18.635964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:18.636468 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:18.695789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:18.697224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:18.709046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:18.709912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:18.711113 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:18.716043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:18.929084 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:18.945499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-168a38ad-e122-4807-97d9-42861dca7b06 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321854 Jul 20 09:16:18.945499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 246/480] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:16:18 2022] POST /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:18.953687 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ce1a5e85-0670-468a-90d1-dc0b7dc4d0c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.253401 Jul 20 09:16:18.954966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 235/481] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:18 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:18.975628 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:18.976598 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:18.986844 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:18.995957 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:18.996339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:18.997189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:18.997641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:19.047189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f HTTP/1.1 Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:16:19.051166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:16:19.052830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'e7d376e6-8b18-47e6-a0d3-d77f6b6e355f'} Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:16:19.053858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:16:19.055186 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:19.056834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:16:19.056834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9283ed0a-dccc-4fbd-96ad-fd77c9becf72 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 404 len: 111 microversion: 2.1 time: 0.105622 Jul 20 09:16:19.056834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 247/482] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:18 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:16:19.067462 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-360f030f-e3d2-4009-b909-aae6fc01a658 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '.version_select at 0x7fadbc4799d0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:19.091498 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-360f030f-e3d2-4009-b909-aae6fc01a658 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380901703" status: 202 len: 0 microversion: 2.1 time: 0.032802 Jul 20 09:16:19.092110 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 236/483] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jul 20 09:16:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1380901703 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:16:19.972977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:19.973602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:19.980699 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:19.981153 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:19.981937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:19.982379 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.056553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:20.057051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:20.063046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:20.063497 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.064264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:20.064698 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.125102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:20.133998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6497003d-3d27-4ca4-bcea-f9ba36a74b45 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1721 microversion: 2.1 time: 0.165656 Jul 20 09:16:20.134564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 248/484] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:19 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:20.196221 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lazy-loading 'services' on Instance uuid ec129daf-9e04-4ed9-bd69-a27ebf04ed38 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:16:20.313158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dd2c1207-c610-4caa-b76e-8e3a085effcb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments/a89d2580-3f8b-4289-8603-5db5044a5895" status: 202 len: 0 microversion: 2.1 time: 0.261265 Jul 20 09:16:20.313792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 237/485] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:16:20 2022] DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments/a89d2580-3f8b-4289-8603-5db5044a5895 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:16:20.324132 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:20.325146 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:20.331983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:20.332531 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.333365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:20.333849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.368295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e565e980-d0fc-4b4a-8a2f-5af25a5e55a1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049737 Jul 20 09:16:20.369073 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 249/486] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:20 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:20.757309 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:20.758277 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:20.764660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:20.765114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.765898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:20.766337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:20.848329 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lazy-loading 'services' on Instance uuid 61f3de74-68ab-4abe-bb79-699e04c14a7c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:16:20.919707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-25990b24-692d-4fcd-8ffd-6497f7c4afbf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "DELETE /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c/os-volume_attachments/6f8dbd1b-60f3-4304-98be-4df3b68fbd03" status: 202 len: 0 microversion: 2.1 time: 0.167117 Jul 20 09:16:20.920295 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 238/487] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:16:20 2022] DELETE /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c/os-volume_attachments/6f8dbd1b-60f3-4304-98be-4df3b68fbd03 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:16:21.151787 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:21.152403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:21.158901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.159600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.160427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.160868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.291334 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:21.299296 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-03160fd1-550b-49bd-b3e6-cbf7a1ed3532 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1698 microversion: 2.1 time: 0.151304 Jul 20 09:16:21.300406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 250/488] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:21 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1698 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:21.318526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ad784eec-ea7d-4c06-a3c3-53463fa25855 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:21.325290 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad784eec-ea7d-4c06-a3c3-53463fa25855 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.325740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ad784eec-ea7d-4c06-a3c3-53463fa25855 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.380603 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:21.381573 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:21.387801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.388053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ad784eec-ea7d-4c06-a3c3-53463fa25855 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Going to try to start instance {{(pid=117871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 09:16:21.388250 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.389021 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.389451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.418448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1e62dde7-727b-4309-8cde-10d470fc3188 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042650 Jul 20 09:16:21.419050 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 251/489] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:21 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:16:21.430398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ad784eec-ea7d-4c06-a3c3-53463fa25855 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action" status: 202 len: 0 microversion: 2.1 time: 0.117095 Jul 20 09:16:21.431092 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 239/490] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:16:21 2022] POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:16:21.438851 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:21.439496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:21.446897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.447537 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.448311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:21.448751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:21.582419 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:21.590576 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0ce3f5ff-9bf5-4fe8-b07a-e8112575caf8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1707 microversion: 2.1 time: 0.155382 Jul 20 09:16:21.591219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 252/491] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:21 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:22.431203 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:22.432199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:22.438337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:22.438836 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:22.439604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:22.440045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:22.470167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3a4f4719-e7a5-402d-8084-816fda1310de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Jul 20 09:16:22.470717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 240/492] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:22 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:22.608214 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:22.608838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:22.616086 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:22.616546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:22.617317 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:22.617762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:22.751673 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:22.760349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-78c08310-4283-4e75-86cc-8d85ed767bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1707 microversion: 2.1 time: 0.156004 Jul 20 09:16:22.760918 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 253/493] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:22 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:23.481542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:23.482467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:23.484915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:23.490761 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:23.491217 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:23.491979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:23.492421 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:23.496810 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:23.524207 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f7d5771d-9262-4ce6-9b30-46739a37ed74 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046558 Jul 20 09:16:23.524760 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 241/494] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:23 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:23.777409 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:23.777931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:23.784424 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:23.784879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:23.785640 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:23.786079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:23.913979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:23.921829 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-72bbca4a-6692-40aa-87dd-35cff720dd52 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1711 microversion: 2.1 time: 0.148412 Jul 20 09:16:23.922390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 254/495] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:23 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1711 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:24.536300 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:24.537246 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:24.543641 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:24.544088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:24.544853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:24.545288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:24.575838 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6590c0b8-f37f-44c1-914b-2f019f1451b1 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Jul 20 09:16:24.576385 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 242/496] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:24 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:25.588628 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:25.589572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:25.596116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:25.597257 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:25.598235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:25.598690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:25.632652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f2107b3d-d174-4a67-8eb0-ba6fd86dfb63 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048664 Jul 20 09:16:25.633236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 255/497] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:25 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:26.483314 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:26.484252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:26.491762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.492214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.492969 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.493408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.516502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'flavor' on Instance uuid d75213b4-13b7-4a52-94ce-1b25a1f03daa {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:16:26.639230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2bec0f90-298f-4beb-aae6-829c0181108a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/action" status: 200 len: 32 microversion: 2.1 time: 0.159652 Jul 20 09:16:26.639752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 243/498] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:16:26 2022] POST /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:16:26.645164 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:26.646100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:26.649052 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:26.649770 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:26.656366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.656700 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.657455 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.657890 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.670005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.670765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.672112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.672780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.719987 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c00cb115-f3f9-4798-9e79-99e38b886714 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072559 Jul 20 09:16:26.721052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 256/499] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:16:26 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:16:26.794426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:26.794964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:26.801836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.802287 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.803109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.803559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.836941 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:16:26.863541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:26.882041 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3c85db01-1493-4795-80ae-3f5d792497a1 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.236834 Jul 20 09:16:26.885664 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 244/500] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:26 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:26.903003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:26.939061 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2a69de2f-f83f-437f-a15b-5af9251f959c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 204 len: 0 microversion: 2.1 time: 0.148152 Jul 20 09:16:26.941549 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 257/501] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:16:26 2022] DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:16:26.949697 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:26.950301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:26.957305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.957748 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:26.958510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:26.958990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:27.090058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:27.097587 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-89dce991-dc21-4666-942a-c3ffd118394c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1678 microversion: 2.1 time: 0.151991 Jul 20 09:16:27.098144 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 245/502] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:26 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:27.297891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:27.298481 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:27.304960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:27.305412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:27.306171 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:27.306604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:27.332035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:16:27.405534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-00174d2a-830a-4a9f-a0a7-6b02f6c3a8d9 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "DELETE /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 204 len: 0 microversion: 2.1 time: 0.111681 Jul 20 09:16:27.406099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 258/503] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:16:27 2022] DELETE /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:16:27.414199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:27.414839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:27.420747 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:27.421193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:27.421948 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:27.422382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:27.547943 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:27.556938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2dfb9ee1-91d4-4d12-9a34-0030152eceaf tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1560 microversion: 2.1 time: 0.146518 Jul 20 09:16:27.557529 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 246/504] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:27 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:27.900936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:27.901649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:27.908175 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:27.908734 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:27.910063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:27.910506 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:28.041105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:28.048997 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5ac1096f-e400-402a-a14c-fc916fa20e47 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.152282 Jul 20 09:16:28.050135 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 259/505] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:27 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:28.115282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:28.115895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:28.121854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:28.122298 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:28.123086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:28.123795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:28.255288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:28.262732 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4526da56-02a1-4787-a32a-6ba2ffb08614 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1678 microversion: 2.1 time: 0.151367 Jul 20 09:16:28.263305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 247/506] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:28 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:28.575122 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:28.575740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:28.582005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:28.582461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:28.583277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:28.583719 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:28.714423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:28.722557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-89a24824-59ba-4445-b672-a0c377f6b392 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1514 microversion: 2.1 time: 0.151469 Jul 20 09:16:28.723159 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 260/507] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:28 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:29.066866 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:29.067515 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:29.074330 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:29.074805 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:29.075561 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:29.075996 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:29.202136 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:29.210814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f7cc36f4-284b-4c4b-90b1-1acccf68f0a4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.148250 Jul 20 09:16:29.211379 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 248/508] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:29 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:29.280170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:29.280789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:29.287407 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:29.287863 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:29.288658 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:29.289101 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:29.416820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:29.425420 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2d0af812-749e-4096-a404-d127c4fd9c18 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1678 microversion: 2.1 time: 0.148346 Jul 20 09:16:29.426015 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 261/509] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:29 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:29.740012 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:29.740629 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:29.746629 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:29.747116 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:29.747878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:29.748315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:29.880936 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:29.888301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-366f95e0-4cf4-46d8-9f7c-d9c33c02afee tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1514 microversion: 2.1 time: 0.152938 Jul 20 09:16:29.888871 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 249/510] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:29 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:30.228201 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:30.228818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:30.234964 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:30.235674 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:30.236445 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:30.237534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:30.370599 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:30.380003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6a35a5fa-6876-4af1-b957-5178c22edd2e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.155560 Jul 20 09:16:30.380610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 262/511] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:30 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:30.443529 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:30.444085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:30.450902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:30.451363 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:30.452137 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:30.452582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:30.585281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:30.592984 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-34e12851-6934-4aff-95b3-ff6b976955ef tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1678 microversion: 2.1 time: 0.154309 Jul 20 09:16:30.593562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 250/512] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:30 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:30.906239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:30.906871 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:30.914213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:30.914657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:30.915446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:30.915875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:31.049198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:31.056854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-62779db6-6904-49a1-87c9-aa21bc88aff4 tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1514 microversion: 2.1 time: 0.154415 Jul 20 09:16:31.057637 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 263/513] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:30 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:31.397608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:31.398223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:31.404749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:31.405199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:31.405973 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:31.406407 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:31.539684 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:31.548000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d95b6bab-68b2-41ec-8c19-da89deea8197 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.154824 Jul 20 09:16:31.548651 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 251/514] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:31 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:31.611210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:31.613037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:31.619494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:31.619946 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:31.620721 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:31.621157 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:31.693270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:31.701149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6bb44351-6d69-4371-b9bf-0f4712a7f481 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 200 len: 1611 microversion: 2.1 time: 0.094227 Jul 20 09:16:31.701713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 264/515] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:31 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 1611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:31.757518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f00adac1-32ae-49d1-98ff-75ecd8a91586 req-8e8af890-7c75-44f3-b427-07e095d94391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f3de74-68ab-4abe-bb79-699e04c14a7c", "name": "network-vif-deleted", "tag": "37e1b242-8f63-4b5a-8083-584fed55dfe1"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:31.769255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f00adac1-32ae-49d1-98ff-75ecd8a91586 req-8e8af890-7c75-44f3-b427-07e095d94391 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:31.769698 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f00adac1-32ae-49d1-98ff-75ecd8a91586 req-8e8af890-7c75-44f3-b427-07e095d94391 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:31.783360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-f00adac1-32ae-49d1-98ff-75ecd8a91586 req-8e8af890-7c75-44f3-b427-07e095d94391 service nova] Creating event network-vif-deleted:37e1b242-8f63-4b5a-8083-584fed55dfe1 for instance 61f3de74-68ab-4abe-bb79-699e04c14a7c on hv-cinder-84330 Jul 20 09:16:31.789761 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f00adac1-32ae-49d1-98ff-75ecd8a91586 req-8e8af890-7c75-44f3-b427-07e095d94391 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035953 Jul 20 09:16:31.790403 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 252/516] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:16:32.074329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:32.075381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:32.082358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.082839 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.083673 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.084107 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.116180 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.116919 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.117399 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lazy-loading 'fault' on Instance uuid 61f3de74-68ab-4abe-bb79-699e04c14a7c {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:16:32.165371 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fed4d6dad5b4a06ae84a26b2aab9850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05578c66d5b14af29cc0d860ed978fbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:32.188942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-69843fcd-cbf9-4c83-b30f-6465ef85a6de tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 200 len: 1309 microversion: 2.1 time: 0.115058 Jul 20 09:16:32.189601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 265/517] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:32 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 1309 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:32.567432 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:32.568148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:32.577098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.577570 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.578366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.578833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.721660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:32.722516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:32.732041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.732766 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.732892 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:32.733835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:32.734273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:32.747236 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bed76d48-404a-4e58-b739-57ea022a5a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.183879 Jul 20 09:16:32.749396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 HTTP/1.1 Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:16:32.751080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:16:32.753185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'ec129daf-9e04-4ed9-bd69-a27ebf04ed38'} Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:16:32.754035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:16:32.755584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:16:32.756920 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:16:32.756920 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6f26782e-fca4-4207-9f6a-36ae04fbda7f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 404 len: 111 microversion: 2.1 time: 0.038125 Jul 20 09:16:32.758187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 266/518] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:32 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:16:32.759408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 253/519] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:32 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:32.763490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1380bfee-cee2-4adc-9081-b41bf58d8844 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '.version_select at 0x7fadafc57af0>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:32.784854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1380bfee-cee2-4adc-9081-b41bf58d8844 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-311198942" status: 202 len: 0 microversion: 2.1 time: 0.024936 Jul 20 09:16:32.785435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 267/520] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jul 20 09:16:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-311198942 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:16:33.208367 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:33.208985 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] [instance: 61f3de74-68ab-4abe-bb79-699e04c14a7c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:33.215106 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:33.215564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:33.216341 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:33.216789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:33.231496 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] HTTP exception thrown: Instance 61f3de74-68ab-4abe-bb79-699e04c14a7c could not be found. Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Request method failure captured: Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c HTTP/1.1 Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18dZtTiZdyxoZLB6a7SnO4WYXFJCqtnt3Mkp6xI5m3mCcMZwKgiUH8YvuveC2uyo3GTqWoNmmTJkySNUXKS83EHQqCOetcns9e4tdNDJW8WFFL8rtdKF9z8zAi87e7FUgwtDYOYJRXnoPU3fZsNgQRkLbEu_Wm8IVOJVMMNcOXDS56w Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 05578c66d5b14af29cc0d860ed978fbf Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1793011931 Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:16:33.233255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/05578c66d5b14af29cc0d860ed978fbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesSnapshotTestJSON-1793011931 Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 05578c66d5b14af29cc0d860ed978fbf Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1793011931 Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesSnapshotTestJSON-1793011931-project Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 7fed4d6dad5b4a06ae84a26b2aab9850 Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesSnapshotTestJSON-1793011931-project Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 61f3de74-68ab-4abe-bb79-699e04c14a7c could not be found. Jul 20 09:16:33.234728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '61f3de74-68ab-4abe-bb79-699e04c14a7c'} Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f3de74-68ab-4abe-bb79-699e04c14a7c could not be found. Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:16:33.235608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f3de74-68ab-4abe-bb79-699e04c14a7c could not be found. Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f3de74-68ab-4abe-bb79-699e04c14a7c could not be found. Jul 20 09:16:33.236740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:33.238139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] Returning 404 to user: Instance 61f3de74-68ab-4abe-bb79-699e04c14a7c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:16:33.238139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-992fff59-19c9-4a2e-9002-9ca55b8c825f tempest-VolumesSnapshotTestJSON-1793011931 tempest-VolumesSnapshotTestJSON-1793011931-project] 10.222.0.44 "GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c" status: 404 len: 111 microversion: 2.1 time: 0.030856 Jul 20 09:16:33.238139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 254/521] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:33 2022] GET /compute/v2.1/servers/61f3de74-68ab-4abe-bb79-699e04c14a7c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:16:33.448723 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4ec347de-5b36-4e85-bd74-a853444b7b5a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: .version_select at 0x7fadafbddb80>, body: {"keypair": {"name": "tempest-keypair-727964092", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXe/jLFDGQbnOjkSIXjPgg7c4oJWLdrqvJirSe6rmIgMUzHvam8/ZSCUXHemp06EzDmKB8giJ40Slm/N9ZsJrTGdEeS1hmjSoayLGI7/E4/aCIlD3Or1gF1z6yKj9fldA=="}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:33.464232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-4ec347de-5b36-4e85-bd74-a853444b7b5a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:16:33.468608 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-4ec347de-5b36-4e85-bd74-a853444b7b5a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:16:33.492855 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4ec347de-5b36-4e85-bd74-a853444b7b5a tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047909 Jul 20 09:16:33.493733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 268/522] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:16:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:33.766319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:33.767053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:33.774869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:33.775415 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:33.776205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:33.776648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:33.807927 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-1d991035-2ff8-4634-83a5-29bd2aa7b3c0 req-880d4dae-11c4-4f19-85d6-572393900e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec129daf-9e04-4ed9-bd69-a27ebf04ed38", "name": "network-vif-deleted", "tag": "1c2570cd-92fc-4346-a17c-e398ca95634d"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:33.816638 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-1d991035-2ff8-4634-83a5-29bd2aa7b3c0 req-880d4dae-11c4-4f19-85d6-572393900e37 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:33.817081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-1d991035-2ff8-4634-83a5-29bd2aa7b3c0 req-880d4dae-11c4-4f19-85d6-572393900e37 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:33.828555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-1d991035-2ff8-4634-83a5-29bd2aa7b3c0 req-880d4dae-11c4-4f19-85d6-572393900e37 service nova] Creating event network-vif-deleted:1c2570cd-92fc-4346-a17c-e398ca95634d for instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 on hv-cinder-84330 Jul 20 09:16:33.833804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-1d991035-2ff8-4634-83a5-29bd2aa7b3c0 req-880d4dae-11c4-4f19-85d6-572393900e37 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030210 Jul 20 09:16:33.834619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 269/523] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:16:33.918889 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:33.927750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1a0c8360-9d51-4cc3-972b-bb01371bd6e7 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.165910 Jul 20 09:16:33.928318 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 255/524] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:33 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:34.808041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1244285417", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82594896-6626-4a61-89e5-7b2f2a36363e"}], "security_groups": [{"name": "tempest-securitygroup--1646038586"}], "key_name": "tempest-keypair-727964092", "user_data": "}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:34.908174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] validate_networks() for [('82594896-6626-4a61-89e5-7b2f2a36363e', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:16:34.945937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:34.946703 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:34.953482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:34.953935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:34.954813 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:34.955255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:35.152233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:35.161006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-61cad95d-d525-4ee8-bac0-397d030f063b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.218931 Jul 20 09:16:35.161588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 256/525] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:34 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:35.350452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:16:35.350916 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:16:35.351490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:16:35.351851 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:16:35.352267 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:16:35.361068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:35.361529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:35.362939 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:35.363382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:35.380595 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:16:35.385154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:16:35.397179 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:16:35.399590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:16:35.445535 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bb950538-2372-43ab-a022-6130a311cab0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.642018 Jul 20 09:16:35.446176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 270/526] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:16:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:16:35.457138 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4e302d3c-0bb1-48e2-b38a-309d761c06db tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:35.457856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4e302d3c-0bb1-48e2-b38a-309d761c06db tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:35.512825 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4e302d3c-0bb1-48e2-b38a-309d761c06db tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:35.520096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4e302d3c-0bb1-48e2-b38a-309d761c06db tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1241 microversion: 2.1 time: 0.067647 Jul 20 09:16:35.520660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 257/527] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:35 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:36.178784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:36.179408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:36.186379 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:36.186873 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:36.187642 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:36.188080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:36.319995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:36.328135 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-004863be-1bc8-49fc-9d80-5225b1d08faf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.154721 Jul 20 09:16:36.328696 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 271/528] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:36 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:36.537518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:36.538049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:36.545181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:36.545637 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:36.546488 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:36.546982 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:36.551537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:36.611908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:36.619295 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-68e0beb5-f104-4337-abc5-cedf4ccb7060 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1245 microversion: 2.1 time: 0.086055 Jul 20 09:16:36.619860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 258/529] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:36 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:37.345179 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:37.345835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:37.352391 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:37.352838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:37.353595 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:37.354027 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:37.487843 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:37.495890 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6bdec3c8-0560-468f-a5c6-2ccd6c6682fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.154506 Jul 20 09:16:37.496466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 272/530] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:37 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:37.637376 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:37.638032 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:37.646100 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:37.646668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:37.647489 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:37.648017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:37.714459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:37.722192 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a20895de-5dc7-4933-b9a6-5a114fc2a138 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1237 microversion: 2.1 time: 0.089156 Jul 20 09:16:37.722819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 259/531] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:37 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:38.513495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:38.514785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:38.521479 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:38.521937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:38.522751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:38.523212 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:38.657799 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:38.665874 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e57b72ed-231a-4159-a8e9-67a18fa3434b tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.156367 Jul 20 09:16:38.666448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 273/532] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:38 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:38.740050 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:38.740833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:38.747817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:38.748350 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:38.749203 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:38.749627 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:38.897650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:38.905269 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f723d608-c810-47db-8467-a16bed574d07 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.169827 Jul 20 09:16:38.915848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 260/533] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:38 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:39.541394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-65e0a0ff-1c30-48c3-b1e9-19a7c0172032 req-b84da3c5-42b4-4726-9039-b8a73435eb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5f5238-e5de-4c38-b0df-42903cdf8bd5", "tag": "0de758bd-1114-495c-ac94-f0c490b2a2c9"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:39.552317 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-65e0a0ff-1c30-48c3-b1e9-19a7c0172032 req-b84da3c5-42b4-4726-9039-b8a73435eb8d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:39.556028 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-65e0a0ff-1c30-48c3-b1e9-19a7c0172032 req-b84da3c5-42b4-4726-9039-b8a73435eb8d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:39.571664 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-65e0a0ff-1c30-48c3-b1e9-19a7c0172032 req-b84da3c5-42b4-4726-9039-b8a73435eb8d service nova] Creating event network-changed:0de758bd-1114-495c-ac94-f0c490b2a2c9 for instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 on hv-cinder-84330 Jul 20 09:16:39.577721 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-65e0a0ff-1c30-48c3-b1e9-19a7c0172032 req-b84da3c5-42b4-4726-9039-b8a73435eb8d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044794 Jul 20 09:16:39.578508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 274/534] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:39.684352 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:39.685135 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:39.692207 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:39.692763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:39.693766 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:39.694385 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:39.828894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:39.837049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c2291170-7e9d-4872-92a3-6d917500a444 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.156801 Jul 20 09:16:39.837626 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 261/535] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:39 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:39.923876 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:39.925127 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:39.931332 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:39.931785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:39.932554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:39.932993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:40.064364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:40.072789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0517c691-83af-45ae-8cef-c482f372e372 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.153137 Jul 20 09:16:40.073352 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 275/536] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:39 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:40.854626 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:40.855270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:40.861744 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:40.862195 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:40.862997 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:40.863444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:40.999832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:41.009214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab742c40-af59-4829-8550-fd46fbf02217 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.158395 Jul 20 09:16:41.009785 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 262/537] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:40 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:41.090146 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:41.090790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:41.093343 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:41.099633 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:41.100091 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:41.100878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:41.101320 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:41.242889 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:41.246348 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:41.253031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5f38c96b-318c-43d0-b8aa-af272e3c7091 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.166164 Jul 20 09:16:41.253621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 276/538] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:41 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:42.026894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:42.027502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:42.034844 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:42.035298 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:42.036060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:42.036495 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:42.167600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:42.175604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-07db928f-aa3e-4027-b5dd-231fa27c5a4d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.152580 Jul 20 09:16:42.176165 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 263/539] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:42 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:42.270193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:42.270840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:42.277866 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:42.278317 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:42.279115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:42.279561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:42.409794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:42.417118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-151b0721-a99f-4c18-ab9e-232e382ba719 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.151973 Jul 20 09:16:42.417689 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 277/540] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:42 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:43.192157 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:43.192719 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:43.199639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:43.200090 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:43.200854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:43.201288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:43.331548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:43.339467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2037992f-3b54-4fa9-a20e-0434a23f4bee tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.151372 Jul 20 09:16:43.340029 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 264/541] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:43 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:43.433937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:43.434551 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:43.442085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:43.442585 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:43.443332 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:43.443770 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:43.573604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:43.581489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-364473ae-b300-4ada-ad0d-c4ccf1d2a5de tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.151664 Jul 20 09:16:43.582055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 278/542] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:43 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:44.356466 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:44.357073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:44.364133 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:44.364580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:44.365335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:44.365765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:44.494366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:44.502827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-234e2baf-28d3-4a15-905c-8e10eaa6f6a2 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.149574 Jul 20 09:16:44.503399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 265/543] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:44 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:44.597822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:44.598433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:44.604902 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:44.605349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:44.606106 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:44.606606 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:44.739972 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:44.747872 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c295ffd7-d0ff-4387-a0cc-92e2ea2b42e3 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.154505 Jul 20 09:16:44.748442 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 279/544] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:44 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:45.520164 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:45.520777 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:45.523174 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:45.528607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:45.529060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:45.529839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:45.530279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:45.667240 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:45.675831 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f3235611-62ce-4926-be19-572960603559 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.159789 Jul 20 09:16:45.676621 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 266/545] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:45 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:45.765413 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:45.766178 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:45.768497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:45.769377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=10 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:45.775466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:45.776013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:45.776991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:45.777432 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:45.910590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:45.917993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a241fe48-06db-4c89-8469-616331e97b32 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.156640 Jul 20 09:16:45.918563 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 280/546] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:45 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:46.218594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f857c8f8-2fb3-4608-9aa2-fe8f15422d5d req-05fc47d7-d2b8-46c1-ab26-789da760358f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5f5238-e5de-4c38-b0df-42903cdf8bd5", "name": "network-vif-plugged", "status": "completed", "tag": "0de758bd-1114-495c-ac94-f0c490b2a2c9"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:46.231067 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f857c8f8-2fb3-4608-9aa2-fe8f15422d5d req-05fc47d7-d2b8-46c1-ab26-789da760358f service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:46.231686 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f857c8f8-2fb3-4608-9aa2-fe8f15422d5d req-05fc47d7-d2b8-46c1-ab26-789da760358f service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:46.244740 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-f857c8f8-2fb3-4608-9aa2-fe8f15422d5d req-05fc47d7-d2b8-46c1-ab26-789da760358f service nova] Creating event network-vif-plugged:0de758bd-1114-495c-ac94-f0c490b2a2c9 for instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 on hv-cinder-84330 Jul 20 09:16:46.249985 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f857c8f8-2fb3-4608-9aa2-fe8f15422d5d req-05fc47d7-d2b8-46c1-ab26-789da760358f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035974 Jul 20 09:16:46.250908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 267/547] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:16:46.692219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:46.692753 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:46.698835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:46.699549 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:46.700325 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:46.700764 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:46.841891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:46.850562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-abec4099-daf7-423a-a9c6-96d496b0ed20 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.162375 Jul 20 09:16:46.851363 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 281/548] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:46 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:46.935819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:46.936557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:46.943094 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:46.943495 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:46.944270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:46.944714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:47.074987 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:47.083055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0e120b40-87ee-417b-ab20-f3a91875ea20 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1367 microversion: 2.1 time: 0.151913 Jul 20 09:16:47.083613 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 268/549] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:46 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:47.868582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:47.869197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:47.875921 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:47.876372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:47.877305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:47.877744 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:48.012118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:48.020385 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d722ac5f-ce24-4d81-9818-b2fb65827172 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.156044 Jul 20 09:16:48.020960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 282/550] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:47 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:48.100085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:48.100708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:48.107234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:48.107691 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:48.108467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:48.108914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:48.235699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:48.243033 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-541e12b5-9d6f-4325-a179-fdc799c80039 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1556 microversion: 2.1 time: 0.147224 Jul 20 09:16:48.243600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 269/551] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:48 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:48.259120 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:48.259626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:48.265712 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:48.266169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:48.266971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:48.267996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:48.347331 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a39ffe2e-f26d-4b7f-9676-c3c3e9738c8c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092004 Jul 20 09:16:48.347937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 283/552] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:16:48 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:49.037978 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:49.038634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:49.044729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:49.045187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:49.045965 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:49.046411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:49.471977 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:49.480283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-94d2002b-0c39-4033-8e0c-b13e7caeacbe tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.446125 Jul 20 09:16:49.480866 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 270/553] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:49 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:49.577629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-16d771cf-644f-459e-88e2-eefa0cf6792f req-c543a518-dd94-4147-a7b4-9e91f49f9cdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5f5238-e5de-4c38-b0df-42903cdf8bd5", "tag": "0de758bd-1114-495c-ac94-f0c490b2a2c9"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:49.586415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-16d771cf-644f-459e-88e2-eefa0cf6792f req-c543a518-dd94-4147-a7b4-9e91f49f9cdf service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:49.586896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-16d771cf-644f-459e-88e2-eefa0cf6792f req-c543a518-dd94-4147-a7b4-9e91f49f9cdf service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:49.598303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-16d771cf-644f-459e-88e2-eefa0cf6792f req-c543a518-dd94-4147-a7b4-9e91f49f9cdf service nova] Creating event network-changed:0de758bd-1114-495c-ac94-f0c490b2a2c9 for instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 on hv-cinder-84330 Jul 20 09:16:49.604210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-16d771cf-644f-459e-88e2-eefa0cf6792f req-c543a518-dd94-4147-a7b4-9e91f49f9cdf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030581 Jul 20 09:16:49.604210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 284/554] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:50.497422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:50.498042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:50.505002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:50.505460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:50.506233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:50.506705 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:50.645086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:50.653366 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5abf10e3-cb70-4aab-8146-9ba572ab68fc tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.159888 Jul 20 09:16:50.653944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 271/555] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:50 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:51.672261 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:51.672963 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:51.679306 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:51.679756 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:51.680509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:51.680941 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:51.809501 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:51.818146 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5b98225f-edf1-44bb-af41-54ef721a6e17 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.150663 Jul 20 09:16:51.818990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 285/556] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:51 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:52.836348 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:52.836914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:52.843605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:52.844060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:52.844828 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:52.845297 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:52.973024 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:52.980971 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9d32447f-96a9-4794-bf0b-618ce77d50bf tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.148594 Jul 20 09:16:52.981532 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 272/557] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:52 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:53.997983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:53.998596 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:54.006101 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:54.006549 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:54.007427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:54.007865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:54.136919 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:54.145704 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-799bc674-8a13-46ea-ad83-d90c07f288ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1733 microversion: 2.1 time: 0.151581 Jul 20 09:16:54.146281 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 286/558] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:53 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:54.791567 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:54.792127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:54.794484 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=66 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:54.801058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:54.801519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:54.802287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:54.802758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:54.834159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d7e3c623-dc36-4985-a3fa-da670cafb850 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments/801dd605-77b1-4651-b938-a04451541016" status: 200 len: 194 microversion: 2.20 time: 0.046559 Jul 20 09:16:54.834752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 273/559] 10.222.0.44 () {60 vars in 1453 bytes} [Wed Jul 20 09:16:54 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments/801dd605-77b1-4651-b938-a04451541016 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:16:54.895566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:54.896059 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:54.902043 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:54.902432 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:54.903222 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:54.903654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:54.982521 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lazy-loading 'services' on Instance uuid 7ce2565b-0061-4f06-950a-4941d97bdc2c {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:16:55.055832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c338f162-121e-4ee7-b1d8-eaed3481c7b8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments/801dd605-77b1-4651-b938-a04451541016" status: 202 len: 0 microversion: 2.20 time: 0.164082 Jul 20 09:16:55.056488 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 287/560] 10.222.0.44 () {60 vars in 1456 bytes} [Wed Jul 20 09:16:54 2022] DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments/801dd605-77b1-4651-b938-a04451541016 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:16:55.065617 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:55.066571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:55.072539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.072988 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.073829 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.074582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.104933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d4185d9b-dd15-4f62-b262-2de9a2c765bf tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044080 Jul 20 09:16:55.105506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 274/561] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jul 20 09:16:55 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 20 09:16:55.164036 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:55.164738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:55.170955 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.171404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.172175 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.172722 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.304431 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:55.312603 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-604be9be-eb94-415b-9bc0-1cd6e8d5b7c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1713 microversion: 2.1 time: 0.152511 Jul 20 09:16:55.313190 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 288/562] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:55 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1713 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:55.416258 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:55.416763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:55.422865 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.423317 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.425000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.425443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.443535 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=100 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:55.508297 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] HTTP exception thrown: Cannot 'detach_volume' instance d75213b4-13b7-4a52-94ce-1b25a1f03daa while it is in vm_state rescued Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Request method failure captured: Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments/26f25154-baf4-4a58-873d-75f4f17f22fe HTTP/1.1 Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cTzeJrq3428VCqYiBkjKlYLR1zNq4B-G31hq6v4Ubpf2ud4niPXu-UrRTnlDAooY5OoddW5uK03xMViJ0lsYc9LM6iAi2Kp1XuPGtl_ybGYmkAvc3E1-HPTkkAg_ELF2Y8fJOJmzRjKojOCuOV0KYZRcrJS1b8xKC0ElPOP3NEe0M Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:16:55.509926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: abdb339c5f5740d6aff4dfd1066f9384 Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:16:55.512556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Cannot 'detach_volume' instance d75213b4-13b7-4a52-94ce-1b25a1f03daa while it is in vm_state rescued Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'server_id': 'd75213b4-13b7-4a52-94ce-1b25a1f03daa', 'id': '26f25154-baf4-4a58-873d-75f4f17f22fe'} Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:16:55.513906 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d75213b4-13b7-4a52-94ce-1b25a1f03daa while it is in vm_state rescued Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d75213b4-13b7-4a52-94ce-1b25a1f03daa while it is in vm_state rescued Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:16:55.516672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Returning 409 to user: Cannot 'detach_volume' instance d75213b4-13b7-4a52-94ce-1b25a1f03daa while it is in vm_state rescued {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:16:55.518864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7fff2b91-12be-43c8-b679-fb57b6988e18 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments/26f25154-baf4-4a58-873d-75f4f17f22fe" status: 409 len: 152 microversion: 2.1 time: 0.099209 Jul 20 09:16:55.518864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 275/563] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:16:55 2022] DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments/26f25154-baf4-4a58-873d-75f4f17f22fe => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 20 09:16:55.524527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:55.525080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:55.531838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.532291 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.533599 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.534035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.609098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-59433dea-1441-44b0-a195-ae814539f54e tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "POST /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/action" status: 202 len: 0 microversion: 2.1 time: 0.088338 Jul 20 09:16:55.613838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 289/564] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:16:55 2022] POST /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:16:55.619172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:55.620042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:55.627822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.628361 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.629208 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:55.629745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:55.776288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:55.785006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-eb3ff7f5-5fc6-4aa0-9c72-8bedf353e3cb tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1721 microversion: 2.1 time: 0.169731 Jul 20 09:16:55.785584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 276/565] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:55 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:56.117519 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:56.118502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:56.127497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.128184 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.128971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.129558 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.160504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8868171a-5d9a-4efb-b614-ad44fe790828 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047297 Jul 20 09:16:56.160892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 290/566] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jul 20 09:16:56 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:16:56.220080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:56.222003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:56.228483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.228930 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.229692 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.230124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.255448 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:16:56.332295 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c0421f44-d1ee-4556-a1ed-130dc02c16fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 204 len: 0 microversion: 2.20 time: 0.115856 Jul 20 09:16:56.333167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 277/567] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jul 20 09:16:56 2022] DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:16:56.341555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:56.342182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:56.350380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.351079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.351850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.352291 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.490816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:56.499941 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:56.501573 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:56.502971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b9899ddd-afb2-43b9-b546-3cdbfd36a326 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.165797 Jul 20 09:16:56.503540 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 291/568] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:56 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:16:56.802089 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:56.802816 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:56.808704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.809153 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.809919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:56.810353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:56.992178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:57.003299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e9d298aa-1779-4777-923e-ef8b64aa8542 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1721 microversion: 2.1 time: 0.205211 Jul 20 09:16:57.010859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 278/569] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:56 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:57.522574 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:57.523271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:57.530769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:57.531215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:57.531972 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:57.532403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:57.663191 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:57.666669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:16:57.671904 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:57.674073 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:57.675651 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-31b95407-a227-44b4-bd02-8fb8701b5c53 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1723 microversion: 2.20 time: 0.158320 Jul 20 09:16:57.676219 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 292/570] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:57 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:16:58.020817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:58.021467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:58.027988 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:58.028443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:58.029211 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:58.029651 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:58.165747 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:58.174567 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2bd49b0c-93db-4015-9222-0547db309d58 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1721 microversion: 2.1 time: 0.157256 Jul 20 09:16:58.175201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 279/571] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:58 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:58.695013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:58.695734 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:58.703769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:58.704973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:58.705778 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:58.706289 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:58.770079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:58.778194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:58.779960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:58.781114 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4c627b0f-9ab9-4687-b916-674271188ba8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1656 microversion: 2.20 time: 0.090718 Jul 20 09:16:58.781690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 293/572] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:58 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:16:58.938825 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-8e248a14-5324-44ae-9449-0bc2008c97bf req-19c6d9ca-b575-47ca-a7a2-e8868f56d9da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ce2565b-0061-4f06-950a-4941d97bdc2c", "name": "network-vif-deleted", "tag": "d9ee2ff0-984d-4cbb-ac06-54bfe850f031"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:16:58.947167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8e248a14-5324-44ae-9449-0bc2008c97bf req-19c6d9ca-b575-47ca-a7a2-e8868f56d9da service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:58.947613 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8e248a14-5324-44ae-9449-0bc2008c97bf req-19c6d9ca-b575-47ca-a7a2-e8868f56d9da service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:58.961362 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-8e248a14-5324-44ae-9449-0bc2008c97bf req-19c6d9ca-b575-47ca-a7a2-e8868f56d9da service nova] Creating event network-vif-deleted:d9ee2ff0-984d-4cbb-ac06-54bfe850f031 for instance 7ce2565b-0061-4f06-950a-4941d97bdc2c on hv-cinder-84330 Jul 20 09:16:58.966159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-8e248a14-5324-44ae-9449-0bc2008c97bf req-19c6d9ca-b575-47ca-a7a2-e8868f56d9da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031039 Jul 20 09:16:58.966767 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 280/573] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:16:59.192845 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:59.193463 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:59.199899 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:59.200352 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:59.201123 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:59.201596 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:59.350077 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:59.370626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-27eefab8-6199-4a98-8f3d-df29e486f4ca tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1721 microversion: 2.1 time: 0.182448 Jul 20 09:16:59.376693 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 294/574] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:16:59 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:16:59.800733 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:16:59.801364 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:16:59.807956 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:59.808414 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:59.809189 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:59.809634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:59.843252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:16:59.843714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:16:59.844155 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lazy-loading 'fault' on Instance uuid 7ce2565b-0061-4f06-950a-4941d97bdc2c {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:16:59.909099 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:59.918459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:59.920055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:16:59.921251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b1122d2f-876a-4235-8979-9522fe79839c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 200 len: 1371 microversion: 2.20 time: 0.125662 Jul 20 09:16:59.921830 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 281/575] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:16:59 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:00.388355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:00.388943 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:00.395468 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:00.395913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:00.396671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:00.397111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:00.529032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:00.537117 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a7330607-6beb-4155-bb99-c14ed1dbe1ce tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1727 microversion: 2.1 time: 0.152558 Jul 20 09:17:00.537689 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 295/576] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:00 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:00.554004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:00.554514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:00.560615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:00.561073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:00.561844 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:00.562286 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:00.638534 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6529058d-30d2-42e3-a969-15d85359351f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088324 Jul 20 09:17:00.639178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 282/577] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:17:00 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:17:00.940070 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:00.940681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:00.946648 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:00.947134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:00.947904 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:00.948342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:00.962105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] HTTP exception thrown: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Request method failure captured: Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c HTTP/1.1 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cVKSpBVrefenRGFmsXAwZwepWHYt4oJIJrF8BIyEHAygjw1hP0-E7k2yeL25UFSMJqXO14shgcz6kEsdTGm0mnLwJe9jB0c08Q8tAv0QV9BbuMRoig2Lc4GSScRG39c176dYl5LBTFotPEXWBO8w_rwHJVzwyoQayCBGFruLXaKME Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:17:00.963769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_752497421a0b4c70a08bcca4393b8837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: f0547075e10c498b8d13e1859197cea0 Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:17:00.965258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '7ce2565b-0061-4f06-950a-4941d97bdc2c'} Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:17:00.966110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:17:00.967489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:00.968592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Returning 404 to user: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:17:00.968592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c7549cca-9465-4d11-9802-1e309d9ec51e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 404 len: 111 microversion: 2.20 time: 0.029171 Jul 20 09:17:00.968592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 296/578] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:00 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:17:00.976337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-84a4cf1a-cb8c-4e56-b5d9-adbe2bdfcc52 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '.version_select at 0x7fadbc479b80>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:00.995096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-84a4cf1a-cb8c-4e56-b5d9-adbe2bdfcc52 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-203854448" status: 204 len: 0 microversion: 2.20 time: 0.023187 Jul 20 09:17:00.995670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 283/579] 10.222.0.44 () {60 vars in 1258 bytes} [Wed Jul 20 09:17:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-203854448 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 20 09:17:01.534139 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-f2ab64c3-c052-48d8-a887-f529ea50140b req-3479932d-feb1-423d-b483-bd9713cce5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75213b4-13b7-4a52-94ce-1b25a1f03daa", "tag": "65b22fc8-0bc5-46a4-a366-8f273ac5f7c6"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:01.570717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f2ab64c3-c052-48d8-a887-f529ea50140b req-3479932d-feb1-423d-b483-bd9713cce5e4 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:01.571868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f2ab64c3-c052-48d8-a887-f529ea50140b req-3479932d-feb1-423d-b483-bd9713cce5e4 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:01.596888 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-f2ab64c3-c052-48d8-a887-f529ea50140b req-3479932d-feb1-423d-b483-bd9713cce5e4 service nova] Creating event network-changed:65b22fc8-0bc5-46a4-a366-8f273ac5f7c6 for instance d75213b4-13b7-4a52-94ce-1b25a1f03daa on hv-cinder-84330 Jul 20 09:17:01.605823 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-f2ab64c3-c052-48d8-a887-f529ea50140b req-3479932d-feb1-423d-b483-bd9713cce5e4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075912 Jul 20 09:17:01.606900 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 297/580] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:17:01.670192 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-de41b5cc-aae5-4507-8546-894e7a6c8364 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'create', calling method: .version_select at 0x7fadbc3ce820>, body: {"keypair": {"name": "tempest-keypair-1670667042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJisypiWoa0P50wVP+zrMF4UcmGhoUa0D0iJnfFVSmzWvodawh7kzYrR/61xg/5Q9f672MaazHesBFjbd6LitrBHqwG2GX7/ngoTbRL3EsUTwCvCc4QtD9SarU8vQJhEog=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:01.687634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-de41b5cc-aae5-4507-8546-894e7a6c8364 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for project 752497421a0b4c70a08bcca4393b8837. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:17:01.692665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-de41b5cc-aae5-4507-8546-894e7a6c8364 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for user f0547075e10c498b8d13e1859197cea0 and project 752497421a0b4c70a08bcca4393b8837. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:17:01.715235 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-de41b5cc-aae5-4507-8546-894e7a6c8364 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050014 Jul 20 09:17:01.716126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 284/581] 10.222.0.44 () {62 vars in 1199 bytes} [Wed Jul 20 09:17:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 20 09:17:03.151093 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-278615220", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c5be41c5-b866-4e37-838a-7883c8ccd3e7"}], "security_groups": [{"name": "tempest-securitygroup--1093164228"}], "key_name": "tempest-keypair-1670667042", "user_data": "}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:03.255644 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] validate_networks() for [('c5be41c5-b866-4e37-838a-7883c8ccd3e7', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:17:03.623935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-16e4e891-d7e5-4752-83cf-6a6f11d5bca9 req-516dc643-d51f-4fcb-a35f-2f73c9c7b3db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d75213b4-13b7-4a52-94ce-1b25a1f03daa", "tag": "65b22fc8-0bc5-46a4-a366-8f273ac5f7c6"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:03.627405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:17:03.627867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:17:03.628337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:17:03.628772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:17:03.629179 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:17:03.633014 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-16e4e891-d7e5-4752-83cf-6a6f11d5bca9 req-516dc643-d51f-4fcb-a35f-2f73c9c7b3db service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:03.633458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-16e4e891-d7e5-4752-83cf-6a6f11d5bca9 req-516dc643-d51f-4fcb-a35f-2f73c9c7b3db service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:03.637885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:03.638511 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:03.639345 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:03.640059 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:03.644002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-16e4e891-d7e5-4752-83cf-6a6f11d5bca9 req-516dc643-d51f-4fcb-a35f-2f73c9c7b3db service nova] Creating event network-changed:65b22fc8-0bc5-46a4-a366-8f273ac5f7c6 for instance d75213b4-13b7-4a52-94ce-1b25a1f03daa on hv-cinder-84330 Jul 20 09:17:03.648786 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-16e4e891-d7e5-4752-83cf-6a6f11d5bca9 req-516dc643-d51f-4fcb-a35f-2f73c9c7b3db service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029144 Jul 20 09:17:03.649663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 285/582] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:17:03.658620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for project 752497421a0b4c70a08bcca4393b8837. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:17:03.663819 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Getting quotas for user f0547075e10c498b8d13e1859197cea0 and project 752497421a0b4c70a08bcca4393b8837. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:17:03.677221 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:17:03.679698 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:17:03.729455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5f42bd6a-60f3-4a24-8d88-f4a480b2b53a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.583476 Jul 20 09:17:03.733735 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 298/583] 10.222.0.44 () {62 vars in 1187 bytes} [Wed Jul 20 09:17:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 20 09:17:03.741457 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6181a51b-1002-463f-a2f6-ff7f4cb54f36 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:03.742167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6181a51b-1002-463f-a2f6-ff7f4cb54f36 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:03.810516 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6181a51b-1002-463f-a2f6-ff7f4cb54f36 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:03.819327 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6181a51b-1002-463f-a2f6-ff7f4cb54f36 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:03.820854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6181a51b-1002-463f-a2f6-ff7f4cb54f36 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:03.821990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6181a51b-1002-463f-a2f6-ff7f4cb54f36 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1281 microversion: 2.20 time: 0.085009 Jul 20 09:17:03.833347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 286/584] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:03 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1281 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:04.841539 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:04.842657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:04.850278 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:04.850763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:04.851552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:04.851996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:04.915081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:04.923315 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:04.924838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:04.925937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ef81c7dd-2cf9-4dbd-b047-4d8d018043e5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1339 microversion: 2.20 time: 0.088919 Jul 20 09:17:04.926500 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 299/585] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:04 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1339 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:05.945008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:05.945646 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:05.953098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:05.953558 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:05.954409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:05.954876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:06.107788 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:06.118114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:06.119649 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:06.120771 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-052ea168-a029-4495-9097-f8c89ba4de85 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.179665 Jul 20 09:17:06.121324 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 287/586] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:05 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:06.331718 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-2d5901ed-5498-4759-af64-215803144375 req-bbc86aec-b711-4997-9702-b7293182ac0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:06.340478 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-2d5901ed-5498-4759-af64-215803144375 req-bbc86aec-b711-4997-9702-b7293182ac0a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:06.340858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-2d5901ed-5498-4759-af64-215803144375 req-bbc86aec-b711-4997-9702-b7293182ac0a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:06.355718 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-2d5901ed-5498-4759-af64-215803144375 req-bbc86aec-b711-4997-9702-b7293182ac0a service nova] Creating event network-changed:21c8f316-fca3-4e77-88cd-b93181b283cf for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 on hv-cinder-84330 Jul 20 09:17:06.365079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-2d5901ed-5498-4759-af64-215803144375 req-bbc86aec-b711-4997-9702-b7293182ac0a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036875 Jul 20 09:17:06.365704 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 300/587] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:07.138024 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:07.138634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:07.145342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:07.145791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:07.146541 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:07.147084 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:07.273968 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:07.282156 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:07.284217 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:07.285337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-11497f35-4312-45f7-8941-c3de3b55f24f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.151232 Jul 20 09:17:07.285893 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 288/588] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:07 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:08.304046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:08.304742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:08.311412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:08.311861 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:08.312660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:08.313044 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:08.442078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:08.450198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:08.451733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:08.452832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-05e5b63f-fb18-458e-a9c4-46c653db772f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.152995 Jul 20 09:17:08.453392 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 301/589] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:08 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:09.471424 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:09.472039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:09.478321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:09.478815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:09.479588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:09.480058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:09.611342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:09.619185 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:09.620684 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:09.621776 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ff7796fe-379b-4f5e-ade1-4a8533449c0f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.155037 Jul 20 09:17:09.622350 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 289/590] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:09 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:10.639609 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:10.640220 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:10.647145 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:10.647601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:10.648382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:10.648825 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:10.777529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:10.785436 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:10.786960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:10.788066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1469e31c-9a3e-421b-8de8-c3c024cf01ce tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.152521 Jul 20 09:17:10.788620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 302/591] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:10 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:17:11.805915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:11.806576 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:11.810326 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:11.810854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:11.813290 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:11.813449 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:11.814325 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:11.815214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:11.816183 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:11.819707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:11.820161 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:11.820938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:11.821375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:11.904865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lazy-loading 'services' on Instance uuid e25fa365-3e8d-4bf5-8914-9ed484c6754a {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:17:11.959515 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:11.968084 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:11.970164 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:11.971368 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-63bafa31-ff2e-455b-b8fe-28ff9eca549a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.169921 Jul 20 09:17:11.982697 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 290/592] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:11 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:11.982854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4621c8c1-4e02-48e1-8afb-db8d0e677d7f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-volume_attachments/100e16fb-85e9-420b-a4d4-6c2ff9274cca" status: 202 len: 0 microversion: 2.1 time: 0.171316 Jul 20 09:17:11.982854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 303/593] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:17:11 2022] DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-volume_attachments/100e16fb-85e9-420b-a4d4-6c2ff9274cca => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:17:12.430699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-9b47854b-05a0-4447-b745-95370953c1d3 req-680189c6-41d0-4fa1-8ec2-42a097a43ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "name": "network-vif-plugged", "status": "completed", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:12.440278 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-9b47854b-05a0-4447-b745-95370953c1d3 req-680189c6-41d0-4fa1-8ec2-42a097a43ce0 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:12.440738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-9b47854b-05a0-4447-b745-95370953c1d3 req-680189c6-41d0-4fa1-8ec2-42a097a43ce0 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:12.452073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-9b47854b-05a0-4447-b745-95370953c1d3 req-680189c6-41d0-4fa1-8ec2-42a097a43ce0 service nova] Creating event network-vif-plugged:21c8f316-fca3-4e77-88cd-b93181b283cf for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 on hv-cinder-84330 Jul 20 09:17:12.458126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-9b47854b-05a0-4447-b745-95370953c1d3 req-680189c6-41d0-4fa1-8ec2-42a097a43ce0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031101 Jul 20 09:17:12.458753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 291/594] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:17:12.998302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:12.998947 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:13.005245 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:13.005695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:13.006464 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:13.006930 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:13.097235 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c5af002a-3f8c-46c6-9c9a-2e6837213d3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:13.103589 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c5af002a-3f8c-46c6-9c9a-2e6837213d3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:13.104131 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c5af002a-3f8c-46c6-9c9a-2e6837213d3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:13.127181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c5af002a-3f8c-46c6-9c9a-2e6837213d3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Going to try to stop instance {{(pid=117871) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 20 09:17:13.140006 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:13.156213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:13.158811 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:13.159938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0789dd12-3854-49f2-b9f8-cd43691535c7 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1407 microversion: 2.20 time: 0.166507 Jul 20 09:17:13.160515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 304/595] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:12 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:13.173471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c5af002a-3f8c-46c6-9c9a-2e6837213d3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action" status: 202 len: 0 microversion: 2.1 time: 0.080554 Jul 20 09:17:13.174251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 292/596] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:17:13 2022] POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:17:13.182147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:13.182927 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:13.189155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:13.189530 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:13.190302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:13.190771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:13.320340 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:13.328072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5a10cbb8-d21f-4547-9f36-e42737c8761f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.149729 Jul 20 09:17:13.328649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 305/597] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:13 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:14.175456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:14.180269 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:14.180976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:14.187526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:14.187987 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:14.188884 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:14.189413 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:14.316203 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:14.324025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:14.325805 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:14.326967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a7bf96be-1487-45ce-ace6-7e5dd791d76c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1599 microversion: 2.20 time: 0.152655 Jul 20 09:17:14.327577 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 293/598] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:17:14 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:17:14.344506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:14.344791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:14.345859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:14.346073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:14.347931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:14.348746 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:14.352445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:14.352908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:14.354272 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:14.354536 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:14.354743 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:14.355188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:14.356029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:14.358081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:14.373261 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:14.473710 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2498963a-8828-4960-9b4e-b6a11f6dafba tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.132726 Jul 20 09:17:14.474308 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 306/599] 10.222.0.44 () {60 vars in 1315 bytes} [Wed Jul 20 09:17:14 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:17:14.828793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:14.837523 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5d69db8d-3abe-41fa-9a6c-913013100b38 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.496564 Jul 20 09:17:14.838104 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 294/600] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:14 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:17:15.642288 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-f8533630-fbfb-413e-8c01-695a641d9a6c req-5194858c-ffab-4308-b3c9-8b8b4a1b0698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:15.650248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f8533630-fbfb-413e-8c01-695a641d9a6c req-5194858c-ffab-4308-b3c9-8b8b4a1b0698 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:15.650734 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f8533630-fbfb-413e-8c01-695a641d9a6c req-5194858c-ffab-4308-b3c9-8b8b4a1b0698 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:15.661984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-f8533630-fbfb-413e-8c01-695a641d9a6c req-5194858c-ffab-4308-b3c9-8b8b4a1b0698 service nova] Creating event network-changed:21c8f316-fca3-4e77-88cd-b93181b283cf for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 on hv-cinder-84330 Jul 20 09:17:15.666841 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-f8533630-fbfb-413e-8c01-695a641d9a6c req-5194858c-ffab-4308-b3c9-8b8b4a1b0698 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028770 Jul 20 09:17:15.667443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 307/601] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:15.856475 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:15.857097 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:15.864222 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:15.864668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:15.865616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:15.866214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:16.006776 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:16.014571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0e22849b-a4cc-4ae3-93b0-4abe4a1c6bad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.162643 Jul 20 09:17:16.015594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 295/602] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:15 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:17.033418 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:17.034078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:17.040267 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:17.040713 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:17.041471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:17.041901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:17.168912 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:17.176556 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2e714996-95d0-47f7-8622-df31301766bf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.148485 Jul 20 09:17:17.177119 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 308/603] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:17 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:18.193817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:18.194433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:18.201218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:18.201663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:18.202423 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:18.202887 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:18.333077 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:18.340509 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8c2c9515-7fa6-4214-adf9-94ca4a9dde01 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.150580 Jul 20 09:17:18.341077 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 296/604] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:18 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:19.359411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:19.361031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:19.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:19.369048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:19.369835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:19.370286 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:19.506794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:19.514620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a182b754-ddca-4fbe-8f14-1b26b443f911 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.159969 Jul 20 09:17:19.515223 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 309/605] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:19 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:20.531008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:20.531626 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:20.538917 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:20.539360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:20.540154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:20.540590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:20.672635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:20.680248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2f549a02-ae70-4453-ab63-873b8cdbacab tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.153197 Jul 20 09:17:20.680816 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 297/606] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:20 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:21.697255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:21.697860 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:21.704867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:21.705309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:21.706066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:21.706498 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:21.834516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:21.844178 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-54c0c945-200d-4e83-b41a-de9407529a0e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.150378 Jul 20 09:17:21.845662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 310/607] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:21 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:22.862107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:22.862745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:22.869182 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:22.869630 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:22.870381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:22.870845 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:23.000152 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:23.008190 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a76dce18-e2b3-44ab-9d51-ce18b60cc302 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1675 microversion: 2.1 time: 0.150104 Jul 20 09:17:23.008750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 298/608] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:22 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:24.025121 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:24.025793 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:24.032783 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:24.033235 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:24.033993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:24.034427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:24.161813 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:24.169237 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ca6b9f96-0033-4fb0-84d9-bb40278a4f3a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1652 microversion: 2.1 time: 0.147972 Jul 20 09:17:24.169834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 311/609] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:24 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1652 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:24.186542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f1cd9e65-559e-4104-a801-cfd35de89d12 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:24.193328 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1cd9e65-559e-4104-a801-cfd35de89d12 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:24.193783 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f1cd9e65-559e-4104-a801-cfd35de89d12 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:24.216375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f1cd9e65-559e-4104-a801-cfd35de89d12 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Going to try to start instance {{(pid=117871) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 20 09:17:24.257491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f1cd9e65-559e-4104-a801-cfd35de89d12 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action" status: 202 len: 0 microversion: 2.1 time: 0.074660 Jul 20 09:17:24.258081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 299/610] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:17:24 2022] POST /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:17:24.267119 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:24.267996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:24.274038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:24.274536 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:24.275347 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:24.275786 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:24.295615 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:24.413253 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:24.420904 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b9c8bb3a-9951-4ebb-85b0-1702b47f7012 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1661 microversion: 2.1 time: 0.158538 Jul 20 09:17:24.421480 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 312/611] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:24 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:25.440638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:25.441373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:25.443309 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:25.448870 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:25.449597 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:25.450367 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:25.450843 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:25.585921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:25.593377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a4714f91-007a-463f-85aa-2b51fd80de78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1661 microversion: 2.1 time: 0.158438 Jul 20 09:17:25.593940 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 300/612] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:25 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1661 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:26.611002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:26.611626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:26.618730 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:26.619193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:26.619968 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:26.620408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:26.750464 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:26.758572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-066fff71-882f-47b4-881b-4b946cf5e58c tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1665 microversion: 2.1 time: 0.152023 Jul 20 09:17:26.759215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 313/613] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:26 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:33.070439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:33.071032 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:33.077879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:33.078327 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:33.079140 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:33.079582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:33.103565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5c200f7b-79f8-4344-9c5d-2c1ce0224e02 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/ips" status: 200 len: 149 microversion: 2.1 time: 0.037004 Jul 20 09:17:33.104121 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 301/614] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:17:33 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:34.413555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf47cd2c-d85d-4fc4-9ab0-deb596fa29db"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:34.414764 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:34.421393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:34.421845 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:34.422763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:34.423207 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:34.658115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b58e01fe-dbb3-4c2e-a4f8-d781b07d1d33 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.247033 Jul 20 09:17:34.658907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 314/615] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:17:34 2022] POST /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 194 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:39.999147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:39.999653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:40.007026 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:40.007490 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:40.008265 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:40.008707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:40.252754 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'services' on Instance uuid d75213b4-13b7-4a52-94ce-1b25a1f03daa {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:17:40.322535 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c90a3de5-b366-4dbd-8390-33e3d2737a7d tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments/26f25154-baf4-4a58-873d-75f4f17f22fe" status: 202 len: 0 microversion: 2.1 time: 0.327157 Jul 20 09:17:40.323404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 302/616] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:17:39 2022] DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments/26f25154-baf4-4a58-873d-75f4f17f22fe => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:17:40.333779 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:40.334873 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:40.341059 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:40.341510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:40.342270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:40.342728 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:40.371595 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-26386777-d8e1-473b-ae53-7b75c067cc7c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043358 Jul 20 09:17:40.372150 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 315/617] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:40 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:41.385081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:41.386445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:41.393983 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:41.394432 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:41.395222 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:41.395657 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:41.427319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-47daa11c-be00-4232-87ad-e1db80df6666 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047198 Jul 20 09:17:41.427890 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 303/618] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:41 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:42.159721 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf47cd2c-d85d-4fc4-9ab0-deb596fa29db"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:42.160795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:42.163246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=26 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:42.168593 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.169045 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.169861 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.170297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.305140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Invalid volume: volume bf47cd2c-d85d-4fc4-9ab0-deb596fa29db is already attached to instances: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: POST /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments HTTP/1.1 Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 74 Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:17:42.306880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {"volumeAttachment": {"volumeId": "bf47cd2c-d85d-4fc4-9ab0-deb596fa29db"}} Jul 20 09:17:42.308518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Invalid volume: volume bf47cd2c-d85d-4fc4-9ab0-deb596fa29db is already attached to instances: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'server_id': '0a5f5238-e5de-4c38-b0df-42903cdf8bd5', 'body': {'volumeAttachment': {'volumeId': 'bf47cd2c-d85d-4fc4-9ab0-deb596fa29db'}}} Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bf47cd2c-d85d-4fc4-9ab0-deb596fa29db is already attached to instances: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:42.309423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bf47cd2c-d85d-4fc4-9ab0-deb596fa29db is already attached to instances: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:42.310960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bf47cd2c-d85d-4fc4-9ab0-deb596fa29db is already attached to instances: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 400 to user: Invalid volume: volume bf47cd2c-d85d-4fc4-9ab0-deb596fa29db is already attached to instances: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5366e8a4-8966-4042-9767-ecb3301c5ebe tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.153303 Jul 20 09:17:42.312430 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 316/619] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:17:42 2022] POST /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:17:42.368859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:42.369355 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:42.375283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.375735 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.376492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.376926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.439682 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:42.440606 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:42.447847 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.448294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.449054 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.449755 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.460895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lazy-loading 'services' on Instance uuid 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:17:42.480133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-467600f3-2670-4ea9-a52a-4a9dbc0eb638 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044554 Jul 20 09:17:42.480726 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 317/620] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:42 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 20 09:17:42.537084 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-27326c94-1b30-4b76-a817-19298c7dd66b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments/bf47cd2c-d85d-4fc4-9ab0-deb596fa29db" status: 202 len: 0 microversion: 2.1 time: 0.171855 Jul 20 09:17:42.538938 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 304/621] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:17:42 2022] DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments/bf47cd2c-d85d-4fc4-9ab0-deb596fa29db => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:17:42.551463 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:42.552612 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:42.559833 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.560292 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.561078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.561521 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.573282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:42.573873 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:42.581989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.582449 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.583254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.583688 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.596380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-712773e8-e202-45c5-aeb3-b4130aecef26 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051231 Jul 20 09:17:42.598086 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 318/622] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:42 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:42.610350 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:17:42.685166 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-18fa2576-f341-4e10-a185-ca9a3d474304 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 204 len: 0 microversion: 2.1 time: 0.116928 Jul 20 09:17:42.685781 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 305/623] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:17:42 2022] DELETE /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:17:42.694495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:42.695203 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:42.701425 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.701880 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.702696 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:42.703181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:42.838109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:42.846536 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b1c77e18-1386-4e82-aa6e-9c0e6518b772 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1687 microversion: 2.1 time: 0.155831 Jul 20 09:17:42.847139 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 319/624] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:42 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:43.610596 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:43.611652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:43.618065 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:43.618519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:43.619322 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:43.619758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:43.648570 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-271eed17-c800-457d-b326-6c6e779cb839 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Jul 20 09:17:43.649116 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 306/625] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:43 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:43.863740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:43.864351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:43.870786 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:43.871233 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:43.871992 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:43.872428 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:43.999291 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:44.006960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bb73c566-a760-41e7-876c-aff11ffaa42a tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1687 microversion: 2.1 time: 0.147033 Jul 20 09:17:44.007529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 320/626] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:43 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1687 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:44.660449 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:44.661375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:44.667791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:44.668234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:44.668992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:44.669426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:44.673827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:44.700454 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1cd9de7b-b6e6-4a06-85cf-d9cb6f26c82e tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044125 Jul 20 09:17:44.701007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 307/627] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:44 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:45.024489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:45.025095 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:45.032455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:45.032901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:45.033661 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:45.034122 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:45.160549 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:45.167984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-785f8abb-1707-427d-8665-67e221d43751 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1687 microversion: 2.1 time: 0.147372 Jul 20 09:17:45.168546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 321/628] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:45 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:45.712293 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:45.713223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:45.719748 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:45.720205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:45.720973 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:45.721413 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:45.750610 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-632c0191-314f-4e3d-9cba-56c8361228b5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041661 Jul 20 09:17:45.751219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 308/629] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:45 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:46.185581 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:46.186192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:46.192917 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.193360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.194121 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.194555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.329124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:46.336671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-395f5322-8443-45e7-a39c-b69e60d708ab tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1687 microversion: 2.1 time: 0.154963 Jul 20 09:17:46.337247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 322/630] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:46 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:46.761685 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:46.762553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:46.769705 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.770150 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.770945 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.771381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.800666 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2821ac2a-0579-4a21-a421-cf1371ad66f0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043077 Jul 20 09:17:46.801230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 309/631] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:17:46 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:17:46.859527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:46.860202 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:46.866141 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.866592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.867410 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.867854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.893310 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:17:46.969979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-dd2e805f-2291-40d2-8533-ff995d989db8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 204 len: 0 microversion: 2.1 time: 0.113345 Jul 20 09:17:46.970826 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 323/632] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:17:46 2022] DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:17:46.979370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:46.980717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:46.989156 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.989607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:46.990442 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:46.990936 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:47.125401 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:47.133011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f562a349-1e71-4ba4-95d3-3f5f71a83d1f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1681 microversion: 2.1 time: 0.157592 Jul 20 09:17:47.133582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 310/633] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:46 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:47.309958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-bd4aed47-e4d2-4114-9e00-cd0182d27e80 req-9c9f3f60-f0b0-47b4-9411-bbed7715f39b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d75213b4-13b7-4a52-94ce-1b25a1f03daa", "name": "network-vif-deleted", "tag": "65b22fc8-0bc5-46a4-a366-8f273ac5f7c6"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:47.319028 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-bd4aed47-e4d2-4114-9e00-cd0182d27e80 req-9c9f3f60-f0b0-47b4-9411-bbed7715f39b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:47.319496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-bd4aed47-e4d2-4114-9e00-cd0182d27e80 req-9c9f3f60-f0b0-47b4-9411-bbed7715f39b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:47.331481 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-bd4aed47-e4d2-4114-9e00-cd0182d27e80 req-9c9f3f60-f0b0-47b4-9411-bbed7715f39b service nova] Creating event network-vif-deleted:65b22fc8-0bc5-46a4-a366-8f273ac5f7c6 for instance d75213b4-13b7-4a52-94ce-1b25a1f03daa on hv-cinder-84330 Jul 20 09:17:47.336391 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-bd4aed47-e4d2-4114-9e00-cd0182d27e80 req-9c9f3f60-f0b0-47b4-9411-bbed7715f39b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030556 Jul 20 09:17:47.337035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 324/634] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:47.353441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:47.354183 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:47.360406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:47.360977 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:47.361839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:47.362340 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:47.431590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:47.439994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a9bf352e-c219-416a-85fd-cd2ab5e50fae tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1621 microversion: 2.1 time: 0.090588 Jul 20 09:17:47.440583 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 311/635] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:47 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1621 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:48.150646 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:48.151126 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:48.158695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:48.159161 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:48.159942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:48.160375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:48.293455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:48.301046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-67d24fce-67e8-476b-91ae-f79cee9a1649 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1681 microversion: 2.1 time: 0.154946 Jul 20 09:17:48.301617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 325/636] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:48 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:17:48.458281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:48.459049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:48.465311 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:48.465769 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:48.466547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:48.467025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:48.499571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:48.500132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:48.500741 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'fault' on Instance uuid d75213b4-13b7-4a52-94ce-1b25a1f03daa {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:17:48.541478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:48.549715 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5fc51d80-d569-44d6-bc0b-74d9cf6d0162 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 200 len: 1335 microversion: 2.1 time: 0.095338 Jul 20 09:17:48.550644 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 312/637] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:48 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:49.319492 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:49.320221 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:49.326988 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:49.327443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:49.329346 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:49.329797 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:49.395719 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:49.400049 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:49.408071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-03bd36a7-decf-4327-b52c-f682fda9f079 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1613 microversion: 2.1 time: 0.092477 Jul 20 09:17:49.414727 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 326/638] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:49 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1613 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:49.567841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:49.568471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: d75213b4-13b7-4a52-94ce-1b25a1f03daa] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:49.575549 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:49.576007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:49.576800 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:49.577248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:49.592248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] HTTP exception thrown: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa could not be found. Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Request method failure captured: Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa HTTP/1.1 Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cTzeJrq3428VCqYiBkjKlYLR1zNq4B-G31hq6v4Ubpf2ud4niPXu-UrRTnlDAooY5OoddW5uK03xMViJ0lsYc9LM6iAi2Kp1XuPGtl_ybGYmkAvc3E1-HPTkkAg_ELF2Y8fJOJmzRjKojOCuOV0KYZRcrJS1b8xKC0ElPOP3NEe0M Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:17:49.594463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: abdb339c5f5740d6aff4dfd1066f9384 Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa could not be found. Jul 20 09:17:49.596103 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'd75213b4-13b7-4a52-94ce-1b25a1f03daa'} Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa could not be found. Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:17:49.596933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa could not be found. Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa could not be found. Jul 20 09:17:49.598299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:49.599453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Returning 404 to user: Instance d75213b4-13b7-4a52-94ce-1b25a1f03daa could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:17:49.599453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3911bb80-b788-4dc4-b1dc-e2fb2bc93e97 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa" status: 404 len: 111 microversion: 2.1 time: 0.032337 Jul 20 09:17:49.599453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 313/639] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:49 2022] GET /compute/v2.1/servers/d75213b4-13b7-4a52-94ce-1b25a1f03daa => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:17:49.604803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2ba88460-0b7d-49f6-9f7c-a5e84ff985d9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '.version_select at 0x7fadafbdd040>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:49.624601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2ba88460-0b7d-49f6-9f7c-a5e84ff985d9 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760029009" status: 202 len: 0 microversion: 2.1 time: 0.023556 Jul 20 09:17:49.625405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 327/640] 10.222.0.44 () {58 vars in 1220 bytes} [Wed Jul 20 09:17:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1760029009 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:17:49.958032 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f5cf4783-8eb3-40e9-85ed-df70e41b904f req-ecdb5f22-df66-4b4b-b1fe-9c96051de7fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5f5238-e5de-4c38-b0df-42903cdf8bd5", "name": "network-vif-deleted", "tag": "0de758bd-1114-495c-ac94-f0c490b2a2c9"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:49.968292 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f5cf4783-8eb3-40e9-85ed-df70e41b904f req-ecdb5f22-df66-4b4b-b1fe-9c96051de7fb service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:49.969753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f5cf4783-8eb3-40e9-85ed-df70e41b904f req-ecdb5f22-df66-4b4b-b1fe-9c96051de7fb service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:49.983218 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-f5cf4783-8eb3-40e9-85ed-df70e41b904f req-ecdb5f22-df66-4b4b-b1fe-9c96051de7fb service nova] Creating event network-vif-deleted:0de758bd-1114-495c-ac94-f0c490b2a2c9 for instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 on hv-cinder-84330 Jul 20 09:17:49.989516 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f5cf4783-8eb3-40e9-85ed-df70e41b904f req-ecdb5f22-df66-4b4b-b1fe-9c96051de7fb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037655 Jul 20 09:17:49.990965 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 314/641] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:50.426273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:50.427672 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:50.434438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:50.435149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:50.436112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:50.436884 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:50.475403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:50.475893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:50.476351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lazy-loading 'fault' on Instance uuid 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:17:50.520338 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:50.527751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-da18928d-2e44-4e36-b7ac-213f69ea3040 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 200 len: 1331 microversion: 2.1 time: 0.106396 Jul 20 09:17:50.528330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 328/642] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:50 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:51.546302 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:51.547033 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:51.554388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:51.554872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:51.555643 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:51.556083 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:51.569511 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 HTTP/1.1 Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:17:51.571181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:17:51.572722 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '0a5f5238-e5de-4c38-b0df-42903cdf8bd5'} Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:17:51.573811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:17:51.575519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:51.576914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:17:51.576914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-57a76d30-97d7-4b80-a5e6-f7c64a56912c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 404 len: 111 microversion: 2.1 time: 0.031139 Jul 20 09:17:51.576914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 315/643] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:51 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:17:51.582076 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f59ffed5-b0c5-4861-8860-5121549cd8b6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '.version_select at 0x7fadafac54c0>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:51.599950 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f59ffed5-b0c5-4861-8860-5121549cd8b6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-727964092" status: 202 len: 0 microversion: 2.1 time: 0.022208 Jul 20 09:17:51.600511 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 329/644] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jul 20 09:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-727964092 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:17:52.208426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-92a121d8-e692-4b27-9b79-91894c9f7b89 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: .version_select at 0x7fadbc2e1e50>, body: {"keypair": {"name": "tempest-keypair-708946796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJOdhcq7jCi2W/cqIIFBlbgpJsl/qLDGOK/LmVvlxH1Y2EHY4ExN8aub1UP9yMXetSL0dqCCmxVB+/dsVr3Zjabv/h/Cx1fVJQ5UvBvSPFIby/Lv0dRyWrvUa+f5CUCfA=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:52.223348 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-92a121d8-e692-4b27-9b79-91894c9f7b89 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:17:52.227206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-92a121d8-e692-4b27-9b79-91894c9f7b89 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:17:52.249332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-92a121d8-e692-4b27-9b79-91894c9f7b89 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045860 Jul 20 09:17:52.249911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 316/645] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:17:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:52.711158 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:52.711686 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:52.717627 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:52.718086 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:52.718893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:52.719381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:52.747322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:17:52.825272 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e92d5371-c078-409f-989a-7dc4a621c637 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 204 len: 0 microversion: 2.1 time: 0.117899 Jul 20 09:17:52.826083 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 330/646] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:17:52 2022] DELETE /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:17:52.834741 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:52.835939 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:52.842610 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:52.842815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:52.843612 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:52.844066 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:53.062091 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:53.070205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1b44e57f-6594-481a-b8b6-ffde3fa01c01 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1507 microversion: 2.1 time: 0.239915 Jul 20 09:17:53.070797 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 317/647] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:52 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:53.652625 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-908076798", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82594896-6626-4a61-89e5-7b2f2a36363e"}], "security_groups": [{"name": "tempest-securitygroup--1660332029"}], "key_name": "tempest-keypair-708946796", "user_data": "}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:53.755377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] validate_networks() for [('82594896-6626-4a61-89e5-7b2f2a36363e', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:17:54.088179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:54.088796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:54.095981 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:54.096426 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:54.097196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:54.097631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:54.299606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:54.307214 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5ccc4f12-9419-48ea-b591-bb8a73c8b283 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1507 microversion: 2.1 time: 0.223060 Jul 20 09:17:54.307795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 318/648] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:54 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1507 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:17:54.389058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:17:54.389482 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:17:54.389956 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:17:54.390388 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:17:54.390828 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:17:54.400198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:54.400642 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:54.401433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:54.401868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:54.419154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:17:54.423152 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Getting quotas for user 9a020687e95a40f88d521757d8b25619 and project 94fff07a1fa347b2b5ff853a2c4f1a1a. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:17:54.433825 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:17:54.436160 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:17:54.481710 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-628c25a0-c523-4e9d-9840-d940cc6648a6 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.887980 Jul 20 09:17:54.482372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 331/649] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:17:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:17:54.492345 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-532a3711-cb76-46ab-b76e-a4df03d5a5d8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:54.492959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-532a3711-cb76-46ab-b76e-a4df03d5a5d8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:54.547404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-532a3711-cb76-46ab-b76e-a4df03d5a5d8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:54.555421 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-532a3711-cb76-46ab-b76e-a4df03d5a5d8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1240 microversion: 2.1 time: 0.066719 Jul 20 09:17:54.558196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 319/650] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:54 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:55.325048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:55.325660 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:55.332417 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:55.332864 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:55.333625 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:55.334057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:55.467068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:55.475026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6c0349f0-8c45-4672-99b1-d4b86e91b91c tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1507 microversion: 2.1 time: 0.154119 Jul 20 09:17:55.475611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 332/651] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:55 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:55.573427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:55.573972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:55.577639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:17:55.586418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:55.587176 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:55.588137 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:55.588816 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:55.662224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:55.670500 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-48b7f45a-06cb-4a5e-9eda-b6a65f7cb4fb tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1310 microversion: 2.1 time: 0.101049 Jul 20 09:17:55.671104 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 320/652] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:55 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1310 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:55.763030 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:17:55.763298 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:17:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:17:56.133942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-f7e7252f-d6f9-4d7b-883a-88aa83f7a091 req-c5df8858-5eaa-4aa6-8513-f6610d0aba40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e44b07d-866d-4c46-b8d0-1330d3387ebe", "name": "network-vif-deleted", "tag": "ae0466e4-d8c3-4cec-9a2b-af74121afd36"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:56.153211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f7e7252f-d6f9-4d7b-883a-88aa83f7a091 req-c5df8858-5eaa-4aa6-8513-f6610d0aba40 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:56.153585 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-f7e7252f-d6f9-4d7b-883a-88aa83f7a091 req-c5df8858-5eaa-4aa6-8513-f6610d0aba40 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:56.167386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-f7e7252f-d6f9-4d7b-883a-88aa83f7a091 req-c5df8858-5eaa-4aa6-8513-f6610d0aba40 service nova] Creating event network-vif-deleted:ae0466e4-d8c3-4cec-9a2b-af74121afd36 for instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe on hv-cinder-84330 Jul 20 09:17:56.173550 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-f7e7252f-d6f9-4d7b-883a-88aa83f7a091 req-c5df8858-5eaa-4aa6-8513-f6610d0aba40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042680 Jul 20 09:17:56.174466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 333/653] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:56.494090 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:56.494920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:56.502587 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:56.503216 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:56.504104 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:56.504648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:56.562175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:56.562983 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:56.563809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'fault' on Instance uuid 9e44b07d-866d-4c46-b8d0-1330d3387ebe {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:17:56.621766 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:56.632327 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-18e02022-bc69-41b2-a5e3-b70c3eaaaaa3 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 200 len: 1312 microversion: 2.1 time: 0.143739 Jul 20 09:17:56.633272 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 321/654] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:56 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:56.691176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:56.692571 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:56.699747 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:56.700346 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:56.701240 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:56.701788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:56.851809 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:56.859492 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2e14d328-1c3c-4840-ae09-4b0951c17172 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1366 microversion: 2.1 time: 0.173969 Jul 20 09:17:56.861189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 334/655] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:56 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:57.649466 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:57.650222 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 9e44b07d-866d-4c46-b8d0-1330d3387ebe] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:57.658252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.658727 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.659518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.659966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.676102 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] HTTP exception thrown: Instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe could not be found. Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Request method failure captured: Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe HTTP/1.1 Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cTzeJrq3428VCqYiBkjKlYLR1zNq4B-G31hq6v4Ubpf2ud4niPXu-UrRTnlDAooY5OoddW5uK03xMViJ0lsYc9LM6iAi2Kp1XuPGtl_ybGYmkAvc3E1-HPTkkAg_ELF2Y8fJOJmzRjKojOCuOV0KYZRcrJS1b8xKC0ElPOP3NEe0M Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:17:57.677667 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: abdb339c5f5740d6aff4dfd1066f9384 Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe could not be found. Jul 20 09:17:57.679043 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '9e44b07d-866d-4c46-b8d0-1330d3387ebe'} Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe could not be found. Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:17:57.680093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe could not be found. Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe could not be found. Jul 20 09:17:57.681315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:17:57.682493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Returning 404 to user: Instance 9e44b07d-866d-4c46-b8d0-1330d3387ebe could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:17:57.682493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-800bd949-3008-434b-b8dc-803c05ad1528 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe" status: 404 len: 111 microversion: 2.1 time: 0.033542 Jul 20 09:17:57.682493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 322/656] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:57 2022] GET /compute/v2.1/servers/9e44b07d-866d-4c46-b8d0-1330d3387ebe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:17:57.687858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:57.688359 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:57.695083 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.695681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.696301 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.696930 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.723113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:17:57.798010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-40168ca7-71f2-4c50-9d04-6c53233b51a6 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "DELETE /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 204 len: 0 microversion: 2.1 time: 0.113080 Jul 20 09:17:57.798484 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 335/657] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:17:57 2022] DELETE /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:17:57.806530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:57.807192 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:57.813441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.813900 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.814661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.815125 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.879534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:57.880249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:57.886608 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.887092 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.887936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:57.888379 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:57.982975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:57.990694 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-397bc2a4-d380-4ca0-a95c-0518ca653721 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.188028 Jul 20 09:17:57.991270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 323/658] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:57 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:58.038618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:58.045938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-589ecf9a-37ea-4040-bbba-3b3b2675c590 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1366 microversion: 2.1 time: 0.171230 Jul 20 09:17:58.046494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 336/659] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:57 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:17:58.211350 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-27ecc981-1ecf-49c4-a618-d8e934689743 req-1498a054-3606-488c-973c-91a69276fbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22f4a54-447d-4e9b-89a8-aeb524a9db9c", "tag": "d592f7bf-83b9-4028-823b-5edc19de7a73"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:17:58.220008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-27ecc981-1ecf-49c4-a618-d8e934689743 req-1498a054-3606-488c-973c-91a69276fbee service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:58.220555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-27ecc981-1ecf-49c4-a618-d8e934689743 req-1498a054-3606-488c-973c-91a69276fbee service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:58.231395 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-27ecc981-1ecf-49c4-a618-d8e934689743 req-1498a054-3606-488c-973c-91a69276fbee service nova] Creating event network-changed:d592f7bf-83b9-4028-823b-5edc19de7a73 for instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c on hv-cinder-84330 Jul 20 09:17:58.236225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-27ecc981-1ecf-49c4-a618-d8e934689743 req-1498a054-3606-488c-973c-91a69276fbee service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028510 Jul 20 09:17:58.236795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 324/660] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:17:59.008570 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:59.009188 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:59.015681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:59.016200 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:59.017493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:59.017928 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:59.063964 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:59.064678 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:59.070970 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:59.071428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:59.072202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:59.072654 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:59.202256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:59.209767 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f38ecfc0-788d-4348-8f47-0e6012b45b3f tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.205049 Jul 20 09:17:59.210341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 337/661] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:59 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:17:59.236957 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:17:59.244538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aeae2aba-0c44-4c00-90c8-c5523fae8d97 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1366 microversion: 2.1 time: 0.185576 Jul 20 09:17:59.245422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 325/662] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:17:59 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:17:59.282391 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:17:59.283094 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:17:59.289135 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:59.289589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:59.290350 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:17:59.290826 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:17:59.314702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b197a3a0-663c-413a-baa0-c069a1b1ba7f tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/ips" status: 200 len: 151 microversion: 2.20 time: 0.100340 Jul 20 09:17:59.315247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 338/663] 10.222.0.44 () {60 vars in 1288 bytes} [Wed Jul 20 09:17:59 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:18:00.226496 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:00.227138 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:00.233681 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:00.234135 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:00.234944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:00.235404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:00.261226 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:00.261940 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:00.269046 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:00.269502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:00.270273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:00.270732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:00.423615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:00.431582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-27295ae0-abda-428e-ae25-8762e6dd3ae4 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.208901 Jul 20 09:18:00.432179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 326/664] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:00 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:00.451330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:00.460511 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1c256207-582b-4c09-96cb-253479b35d7b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1366 microversion: 2.1 time: 0.202877 Jul 20 09:18:00.461098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 339/665] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:00 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1366 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:18:01.363320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:01.363895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:01.370363 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.370884 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.371661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.372106 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.395335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lazy-loading 'flavor' on Instance uuid 5e2a29ba-3d49-40ed-9086-5a9f73558649 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:18:01.421124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:01.448508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:01.449119 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:01.456930 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.457378 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.458150 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.458589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.602113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:01.609462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9a88a769-1963-4911-99a9-96890fe7f532 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1521 microversion: 2.1 time: 0.164778 Jul 20 09:18:01.610625 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 340/666] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:01 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:18:01.615405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:01.616052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:01.622382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.622873 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.623635 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.624071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.650192 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab3dcd8f-480d-4571-b6df-d85e031a0350 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/action" status: 202 len: 0 microversion: 2.20 time: 0.291206 Jul 20 09:18:01.655460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 327/667] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jul 20 09:18:01 2022] POST /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:18:01.662215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:01.662996 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:01.672896 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.673431 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.674391 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:01.674878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:01.840034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:01.848971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4402f1fc-b79a-49ce-ae0d-c54cabac74e5 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1366 microversion: 2.1 time: 0.237326 Jul 20 09:18:01.849553 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 341/668] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:01 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:01.867935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:01.876122 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:01.877648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:01.878915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7cc5cbe5-bf43-40a4-a27f-f6a5a27f8e24 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.222043 Jul 20 09:18:01.879473 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 328/669] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:01 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:02.505089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-79a5903f-025f-44e6-ba39-af7c421be2d2 req-0e2024e8-a219-4a5a-b8b6-f60f663e4d2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b882a32-6794-4188-824a-7d2e1c061e67", "name": "network-vif-deleted", "tag": "81e28f7f-49b2-4bf3-a0f2-30ff46f71e2c"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:02.514785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-79a5903f-025f-44e6-ba39-af7c421be2d2 req-0e2024e8-a219-4a5a-b8b6-f60f663e4d2c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.515294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-79a5903f-025f-44e6-ba39-af7c421be2d2 req-0e2024e8-a219-4a5a-b8b6-f60f663e4d2c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.528424 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-79a5903f-025f-44e6-ba39-af7c421be2d2 req-0e2024e8-a219-4a5a-b8b6-f60f663e4d2c service nova] Creating event network-vif-deleted:81e28f7f-49b2-4bf3-a0f2-30ff46f71e2c for instance 4b882a32-6794-4188-824a-7d2e1c061e67 on hv-cinder-84330 Jul 20 09:18:02.533688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-79a5903f-025f-44e6-ba39-af7c421be2d2 req-0e2024e8-a219-4a5a-b8b6-f60f663e4d2c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 Jul 20 09:18:02.534405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 342/670] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:02.593706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-2131f3d6-6339-43ad-bb54-e76b429ebd88 req-9501a57f-a426-49a9-a441-31d3f88f2c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22f4a54-447d-4e9b-89a8-aeb524a9db9c", "name": "network-vif-plugged", "status": "completed", "tag": "d592f7bf-83b9-4028-823b-5edc19de7a73"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:02.605772 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2131f3d6-6339-43ad-bb54-e76b429ebd88 req-9501a57f-a426-49a9-a441-31d3f88f2c89 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.606219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2131f3d6-6339-43ad-bb54-e76b429ebd88 req-9501a57f-a426-49a9-a441-31d3f88f2c89 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.619664 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-2131f3d6-6339-43ad-bb54-e76b429ebd88 req-9501a57f-a426-49a9-a441-31d3f88f2c89 service nova] Creating event network-vif-plugged:d592f7bf-83b9-4028-823b-5edc19de7a73 for instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c on hv-cinder-84330 Jul 20 09:18:02.624638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-2131f3d6-6339-43ad-bb54-e76b429ebd88 req-9501a57f-a426-49a9-a441-31d3f88f2c89 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035074 Jul 20 09:18:02.626947 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 329/671] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:02.629848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:02.630549 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:02.637131 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.637827 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.638832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.639433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.675630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.676273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.676728 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lazy-loading 'fault' on Instance uuid 4b882a32-6794-4188-824a-7d2e1c061e67 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:18:02.720879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abdb339c5f5740d6aff4dfd1066f9384', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ee1fe6a5044166ba49d2a44e353f52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:02.724407 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:02.729494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9610a760-df2b-42ff-9447-b0848ce4ee57 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 200 len: 1311 microversion: 2.1 time: 0.105365 Jul 20 09:18:02.730077 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 343/672] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:02 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:02.866765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:02.867932 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:02.874875 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.875323 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.876111 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.876557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.897209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:02.898082 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:02.906277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.907311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:02.908085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:02.908517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:03.079570 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:03.086962 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-054e1ddd-f4a8-44c9-bb66-77bb9fdf4140 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1366 microversion: 2.1 time: 0.224512 Jul 20 09:18:03.087527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 330/673] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:02 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:18:03.105157 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:03.114348 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:03.115938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:03.117164 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2d3301c5-366f-4602-8910-4920fb3becf9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.223763 Jul 20 09:18:03.117748 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 344/674] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:02 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:03.746607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:03.747274 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] [instance: 4b882a32-6794-4188-824a-7d2e1c061e67] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:03.753958 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:03.754409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:03.755206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:03.755647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:03.769610 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] HTTP exception thrown: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 could not be found. Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Request method failure captured: Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 HTTP/1.1 Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cTzeJrq3428VCqYiBkjKlYLR1zNq4B-G31hq6v4Ubpf2ud4niPXu-UrRTnlDAooY5OoddW5uK03xMViJ0lsYc9LM6iAi2Kp1XuPGtl_ybGYmkAvc3E1-HPTkkAg_ELF2Y8fJOJmzRjKojOCuOV0KYZRcrJS1b8xKC0ElPOP3NEe0M Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:18:03.771264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/19ee1fe6a5044166ba49d2a44e353f52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 19ee1fe6a5044166ba49d2a44e353f52 Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1359679382 Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: abdb339c5f5740d6aff4dfd1066f9384 Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1359679382-project Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 could not be found. Jul 20 09:18:03.772834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '4b882a32-6794-4188-824a-7d2e1c061e67'} Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 could not be found. Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:18:03.773702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 could not be found. Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 could not be found. Jul 20 09:18:03.775188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:18:03.776445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] Returning 404 to user: Instance 4b882a32-6794-4188-824a-7d2e1c061e67 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:18:03.776445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ba748649-0510-46b7-9983-57a7cffc42c0 tempest-ServerRescueNegativeTestJSON-1359679382 tempest-ServerRescueNegativeTestJSON-1359679382-project] 10.222.0.44 "GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67" status: 404 len: 111 microversion: 2.1 time: 0.029937 Jul 20 09:18:03.776445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 331/675] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:03 2022] GET /compute/v2.1/servers/4b882a32-6794-4188-824a-7d2e1c061e67 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:18:04.105662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:04.106297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:04.108922 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:04.117458 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:04.117891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:04.118899 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:04.119501 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:04.136227 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:04.137147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:04.145812 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:04.146272 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:04.147556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:04.148006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:04.323518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:04.330167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:04.338795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:04.338989 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c9dfe791-550e-40ba-a49e-dfdbd5645ec8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1555 microversion: 2.1 time: 0.237854 Jul 20 09:18:04.340628 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:04.341323 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-444cd414-e0be-4fa3-9de5-dc60d8cb255e tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.208946 Jul 20 09:18:04.343008 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 332/676] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:04 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:04.351623 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 345/677] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:04 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1555 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:04.357220 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:04.357848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:04.364598 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:04.365059 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:04.365967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:04.366420 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:04.446604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-74e96454-4fab-4107-ae74-5de7c73822f9 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093441 Jul 20 09:18:04.447279 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 333/678] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:18:04 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:05.361816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:05.362401 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:05.365553 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:05.366201 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:05.373413 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.374058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.375095 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.376448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.425002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-adbf5e59-650d-46c0-b79f-7028ada38383 req-cddb6968-70cd-4483-ac1f-af004dc0ee4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f22f4a54-447d-4e9b-89a8-aeb524a9db9c", "tag": "d592f7bf-83b9-4028-823b-5edc19de7a73"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:05.434169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:05.437575 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-adbf5e59-650d-46c0-b79f-7028ada38383 req-cddb6968-70cd-4483-ac1f-af004dc0ee4d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.438989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-adbf5e59-650d-46c0-b79f-7028ada38383 req-cddb6968-70cd-4483-ac1f-af004dc0ee4d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.453151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-adbf5e59-650d-46c0-b79f-7028ada38383 req-cddb6968-70cd-4483-ac1f-af004dc0ee4d service nova] Creating event network-changed:d592f7bf-83b9-4028-823b-5edc19de7a73 for instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c on hv-cinder-84330 Jul 20 09:18:05.458959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-adbf5e59-650d-46c0-b79f-7028ada38383 req-cddb6968-70cd-4483-ac1f-af004dc0ee4d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040250 Jul 20 09:18:05.460137 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 334/679] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:18:05.539465 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:05.548335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:05.550951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:05.552412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ca0cb1ab-51aa-43d5-ac2a-16adc8af75f6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.196131 Jul 20 09:18:05.553254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 346/680] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:05 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:05.832189 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:05.834015 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:05.840582 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.841309 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.842305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.842990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.879104 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a904ad8a-6fff-444e-b018-9bb5f35a5fc2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051641 Jul 20 09:18:05.885334 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 335/681] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:18:05 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:18:05.953271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:05.954237 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:05.962118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.963018 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.964006 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:05.964758 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:05.996499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:18:06.133946 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6c983178-3d92-497c-b3bc-9c5d30a7d23a tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 204 len: 0 microversion: 2.1 time: 0.182506 Jul 20 09:18:06.144547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:06.145958 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:06.151116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 347/682] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:18:05 2022] DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:18:06.155835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:06.157175 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:06.161979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:06.163435 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:06.577906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:06.579894 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:06.586319 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:06.591312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:06.592284 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:06.592600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:06.661288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:06.671072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-92df43d6-a552-42e2-b396-eda2029a82ad tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1671 microversion: 2.1 time: 0.530941 Jul 20 09:18:06.671784 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 336/683] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:06 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1671 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:18:06.831872 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:06.841875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:06.843500 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:06.845090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b74e6e54-25a6-4f53-a8d6-da8fc9085ec4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.275425 Jul 20 09:18:06.845566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 348/684] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:06 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:07.690976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:07.691607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:07.703974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:07.704513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:07.705348 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:07.705818 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:07.862732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:07.864321 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:07.871762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:07.872630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:07.873629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:07.874247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:08.085347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:08.094324 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-29811474-6685-4479-868e-b507c47320d6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1671 microversion: 2.1 time: 0.408689 Jul 20 09:18:08.095660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 337/685] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:07 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1671 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:08.168405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:08.184415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:08.186260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:08.187765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8bc30e68-f201-43dc-8507-77c121f20c26 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.328943 Jul 20 09:18:08.188566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 349/686] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:07 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:08.881417 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-7b2aca39-a8b3-4fff-b02f-ffa674dc186b req-33ce9fc2-5ce4-4e4f-8d66-8d1cd91c90da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e25fa365-3e8d-4bf5-8914-9ed484c6754a", "name": "network-vif-deleted", "tag": "d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:08.896797 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7b2aca39-a8b3-4fff-b02f-ffa674dc186b req-33ce9fc2-5ce4-4e4f-8d66-8d1cd91c90da service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:08.897530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7b2aca39-a8b3-4fff-b02f-ffa674dc186b req-33ce9fc2-5ce4-4e4f-8d66-8d1cd91c90da service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:08.920733 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-7b2aca39-a8b3-4fff-b02f-ffa674dc186b req-33ce9fc2-5ce4-4e4f-8d66-8d1cd91c90da service nova] Creating event network-vif-deleted:d0cbf9ee-17b1-4b3d-bcea-9654dc46b5ab for instance e25fa365-3e8d-4bf5-8914-9ed484c6754a on hv-cinder-84330 Jul 20 09:18:08.932708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-7b2aca39-a8b3-4fff-b02f-ffa674dc186b req-33ce9fc2-5ce4-4e4f-8d66-8d1cd91c90da service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055209 Jul 20 09:18:08.935577 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 338/687] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:09.115372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:09.116682 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:09.123969 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:09.124427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:09.125806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:09.126256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:09.159814 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:09.160512 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:09.161087 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lazy-loading 'fault' on Instance uuid e25fa365-3e8d-4bf5-8914-9ed484c6754a {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:18:09.206925 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:09.207876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:09.215918 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:09.216373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:09.217156 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:09.217602 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:09.223868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:09.233227 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a8b56704-63b7-442d-a0ac-497a500b74c2 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 200 len: 1326 microversion: 2.1 time: 0.124996 Jul 20 09:18:09.233821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 350/688] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:09 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 1326 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:09.400339 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:09.409638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:09.411580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:09.413049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-97cdd0d7-6f64-4709-9385-3c6dfc79e399 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.211232 Jul 20 09:18:09.425232 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 339/689] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:09 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:10.252883 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:10.254180 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:10.260554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:10.261007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:10.262032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:10.262521 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:10.277194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] HTTP exception thrown: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Request method failure captured: Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a HTTP/1.1 Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18do-FP05Ry6MAjUEPFWkvh4Uzu43hSRTwj1uoPeypXtSedRJ08AuH65StzvpmhRECko9oX9DgQr8TINCYeLgAxJW31ZGTrYtwtw8Jms18Zga0cPu8cHkvFt0ww9HQvTeDBNBOfL7eZemFV5U6oB_0XybWO024BN5STIN7WdI3CH5YE Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:18:10.278960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6476016c570542d3b00f9ed1507655da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6476016c570542d3b00f9ed1507655da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 0a3ed8bea97e49628311cb45d48ca699 Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:18:10.280659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'e25fa365-3e8d-4bf5-8914-9ed484c6754a'} Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:18:10.285613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:18:10.287002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:18:10.288337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Returning 404 to user: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:18:10.288337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-cbedf663-1674-4898-98d5-b85d65fbdddb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 404 len: 111 microversion: 2.1 time: 0.032548 Jul 20 09:18:10.288337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 351/690] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:10 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:18:10.290118 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cec4a628-35ab-4ff8-b449-3aaf11f3c11e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '.version_select at 0x7fadbc2e1f70>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:10.312422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cec4a628-35ab-4ff8-b449-3aaf11f3c11e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-149059309" status: 202 len: 0 microversion: 2.1 time: 0.026345 Jul 20 09:18:10.313287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 340/691] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jul 20 09:18:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-149059309 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:18:10.432795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:10.433418 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:10.440207 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:10.440667 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:10.441455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:10.441897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:10.585450 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:10.593615 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:10.595745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:10.596908 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-cf445da8-3def-4a95-b94e-d02fe25248ab tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.168373 Jul 20 09:18:10.597465 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 352/692] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:10 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:10.933198 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-daeb0c38-fb52-4f30-a091-2a3ab851b7f8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: .version_select at 0x7fadbc212040>, body: {"keypair": {"name": "tempest-keypair-27688704", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBihD6gP31GImkpvGRfblkV2qRBEkEq0cfO+W8zgzR6KrELZ4+xKBpu6BQ3127x4hK1usUBc32Sh/xPj80d8ZecvEYSckkkx4zfsk2Feu3kru79Z1GJBtQ4XdLrLo3UyQ=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:10.947076 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-daeb0c38-fb52-4f30-a091-2a3ab851b7f8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for project 6476016c570542d3b00f9ed1507655da. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:18:10.951154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-daeb0c38-fb52-4f30-a091-2a3ab851b7f8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for user 0a3ed8bea97e49628311cb45d48ca699 and project 6476016c570542d3b00f9ed1507655da. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:18:10.974122 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-daeb0c38-fb52-4f30-a091-2a3ab851b7f8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044758 Jul 20 09:18:10.974730 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 341/693] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:18:10 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:11.615455 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:11.616108 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:11.622714 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:11.623268 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:11.624058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:11.624500 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:11.760442 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:11.769798 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:11.771384 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:11.772554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a0245e0e-8b6d-409b-b818-c0cfbce144a6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.161225 Jul 20 09:18:11.773116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 353/694] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:11 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:12.251188 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1915143829", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cf837b36-0fb7-4a6a-9845-400e75c9cec0"}], "security_groups": [{"name": "tempest-securitygroup--1897655304"}], "key_name": "tempest-keypair-27688704", "user_data": "}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:12.349533 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] validate_networks() for [('cf837b36-0fb7-4a6a-9845-400e75c9cec0', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:18:12.791270 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:12.792124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:12.800490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:12.801552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:12.802849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:12.803577 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:12.832321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:18:12.832713 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:18:12.833545 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:18:12.834217 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:18:12.834954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:18:12.861663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:12.862136 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:12.862994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:12.863440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:12.894547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for project 6476016c570542d3b00f9ed1507655da. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:18:12.899122 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Getting quotas for user 0a3ed8bea97e49628311cb45d48ca699 and project 6476016c570542d3b00f9ed1507655da. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:18:12.912717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:18:12.915220 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:18:12.972763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2b890063-3548-49fa-9e20-cd97db9c1393 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.726746 Jul 20 09:18:12.973343 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:12.973798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 342/695] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:18:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:18:12.982579 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:12.983560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e3c57140-d7b9-48de-bbe4-abee53707603 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:12.984219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e3c57140-d7b9-48de-bbe4-abee53707603 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:12.984438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:12.986281 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-475c006e-497e-4f99-b60f-2ce0a1d365f5 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.199411 Jul 20 09:18:12.986863 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 354/696] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:12 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:13.040976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e3c57140-d7b9-48de-bbe4-abee53707603 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:13.048130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e3c57140-d7b9-48de-bbe4-abee53707603 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1236 microversion: 2.1 time: 0.068433 Jul 20 09:18:13.048696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 343/697] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:12 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:18:14.004800 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:14.005412 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:14.012609 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:14.013346 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:14.014952 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:14.015582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:14.065921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:14.066479 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:14.084769 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:14.090861 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:14.091912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:14.092381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:14.214814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:14.222921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0323c40e-16cb-4d45-818f-8bbc55a8eaed tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1294 microversion: 2.1 time: 0.161383 Jul 20 09:18:14.223492 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 344/698] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:14 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1294 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:18:14.226439 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:14.235145 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:14.236923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:14.238100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f911d8a8-8516-4143-82f8-8e701974a984 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.237870 Jul 20 09:18:14.238753 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 355/699] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:13 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:15.240671 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:15.241313 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:15.248023 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:15.248557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:15.249402 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:15.250519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:15.257007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:15.258335 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:15.264701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:15.265493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:15.266567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:15.267209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:15.471246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:15.477565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:15.480234 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:15.482181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:15.484263 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1b68c1a7-f8a8-46e4-a0d1-845dc46f79c0 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.231514 Jul 20 09:18:15.485185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 356/700] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:15 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:15.488302 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5c4b0b52-03a5-466d-9624-f64ad4a37194 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.251272 Jul 20 09:18:15.489088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 345/701] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:15 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:15.758989 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-679df4d7-fac6-4d32-b3f2-dc57e851389d req-3549203d-be15-4b8f-b4d8-aa4898512657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f6226c-6db8-4dc7-9666-36be348f5773", "tag": "8ef4dc8c-6218-451a-9f87-a8a34a78700a"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:15.767686 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-679df4d7-fac6-4d32-b3f2-dc57e851389d req-3549203d-be15-4b8f-b4d8-aa4898512657 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:15.768362 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-679df4d7-fac6-4d32-b3f2-dc57e851389d req-3549203d-be15-4b8f-b4d8-aa4898512657 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:15.782862 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-679df4d7-fac6-4d32-b3f2-dc57e851389d req-3549203d-be15-4b8f-b4d8-aa4898512657 service nova] Creating event network-changed:8ef4dc8c-6218-451a-9f87-a8a34a78700a for instance a1f6226c-6db8-4dc7-9666-36be348f5773 on hv-cinder-84330 Jul 20 09:18:15.788751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-679df4d7-fac6-4d32-b3f2-dc57e851389d req-3549203d-be15-4b8f-b4d8-aa4898512657 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033659 Jul 20 09:18:15.789788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 357/702] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:16.505408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:16.506020 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:16.506348 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:16.507104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:16.512499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:16.512944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:16.513221 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:16.513681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:16.513824 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:16.514128 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:16.514450 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:16.514916 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:16.710502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:16.713803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:16.718528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:16.720730 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:16.721996 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3d659dfc-7ff1-490d-97d6-ec72dbf56887 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.220550 Jul 20 09:18:16.722128 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-904bd405-2f51-46b9-bfed-98be3ebd6a9f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.220352 Jul 20 09:18:16.722699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 346/704] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:16 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:16.722822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 358/704] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:16 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:17.739537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:17.740178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:17.740330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:17.740945 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:17.746803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:17.747267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:17.747456 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:17.747914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:17.748051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:17.748472 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:17.748690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:17.749131 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:17.943514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:17.947758 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:17.951424 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b66e3dfb-7156-4f66-83a4-b31e9da57c3f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.215691 Jul 20 09:18:17.951740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:17.954111 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 347/705] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:17 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:17.957006 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:17.958590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:17.959848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0c949814-d3c6-42d9-978d-9ebe8d35b020 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1744 microversion: 2.20 time: 0.223398 Jul 20 09:18:17.960483 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 359/706] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:17 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:18.968078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:18.969283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:18.975999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:18.976514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:18.977500 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:18.978039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:18.978504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:18.979153 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:18.987058 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:18.987512 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:18.988301 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:18.988737 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:19.172892 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:19.179354 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:19.180763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2be6e59b-972a-4149-a175-547bf27e7ac4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.216508 Jul 20 09:18:19.181346 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 348/707] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:18 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:19.187808 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:19.189465 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:19.190618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d8eb1bf1-19ae-42c1-877e-3c9127b74cbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1744 microversion: 2.20 time: 0.216086 Jul 20 09:18:19.191210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 360/708] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:18 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1744 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:20.197542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:20.198354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:20.206068 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:20.206524 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:20.207334 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:20.207898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:20.209530 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:20.210837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:20.217891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:20.218360 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:20.219330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:20.219819 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:20.470422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:20.477069 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:20.495001 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:20.501528 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:20.503086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9226c41f-8139-4391-8839-4c6d54976753 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.309218 Jul 20 09:18:20.505031 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 349/709] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:20 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:20.505893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:20.507419 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a2d9c155-c730-417e-9ab5-a93119c38479 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.302105 Jul 20 09:18:20.511724 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 361/710] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:20 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:20.706319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-304d01c4-c585-4422-9dae-6b4408c1ba8e req-e2ad8a94-a153-4491-8465-df683a40b03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "name": "network-vif-plugged", "status": "completed", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:20.721775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-304d01c4-c585-4422-9dae-6b4408c1ba8e req-e2ad8a94-a153-4491-8465-df683a40b03c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:20.722237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-304d01c4-c585-4422-9dae-6b4408c1ba8e req-e2ad8a94-a153-4491-8465-df683a40b03c service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:20.734228 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-304d01c4-c585-4422-9dae-6b4408c1ba8e req-e2ad8a94-a153-4491-8465-df683a40b03c service nova] Creating event network-vif-plugged:21c8f316-fca3-4e77-88cd-b93181b283cf for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 on hv-cinder-84330 Jul 20 09:18:20.744347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-304d01c4-c585-4422-9dae-6b4408c1ba8e req-e2ad8a94-a153-4491-8465-df683a40b03c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056584 Jul 20 09:18:20.745268 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 350/711] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:21.524258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:21.526576 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:21.537606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:21.538912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:21.546213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:21.548458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:21.549390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:21.549687 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:21.550735 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:21.550852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:21.551566 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:21.552157 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:21.784802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:21.792548 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-92ea03cd-8b9a-4b12-92c6-07abacfec40d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.273446 Jul 20 09:18:21.803355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 362/712] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:21 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:21.821472 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:21.830355 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:21.831974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:21.833147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d42b87b3-1c93-4bbf-a4dc-a5626b843724 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.303487 Jul 20 09:18:21.833992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 351/713] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:21 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:22.764198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-ada026b0-c785-4390-8e7a-6464e037d294 req-ce8f5df8-51c9-4ae0-84b3-6776a1951311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f6226c-6db8-4dc7-9666-36be348f5773", "name": "network-vif-plugged", "status": "completed", "tag": "8ef4dc8c-6218-451a-9f87-a8a34a78700a"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:22.774761 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-ada026b0-c785-4390-8e7a-6464e037d294 req-ce8f5df8-51c9-4ae0-84b3-6776a1951311 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:22.775368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-ada026b0-c785-4390-8e7a-6464e037d294 req-ce8f5df8-51c9-4ae0-84b3-6776a1951311 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:22.788465 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-ada026b0-c785-4390-8e7a-6464e037d294 req-ce8f5df8-51c9-4ae0-84b3-6776a1951311 service nova] Creating event network-vif-plugged:8ef4dc8c-6218-451a-9f87-a8a34a78700a for instance a1f6226c-6db8-4dc7-9666-36be348f5773 on hv-cinder-84330 Jul 20 09:18:22.793862 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-ada026b0-c785-4390-8e7a-6464e037d294 req-ce8f5df8-51c9-4ae0-84b3-6776a1951311 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035821 Jul 20 09:18:22.794575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 363/714] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:18:22.813465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:22.814303 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:22.822039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:22.822869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:22.823877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:22.824941 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:22.852495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:22.853671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:22.865068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:22.867026 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:22.868089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:22.869586 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:22.890915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:23.046587 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=12 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:23.111385 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:23.119213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:23.127537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e4217f60-5d08-4221-9e45-e605927b4fb9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.317963 Jul 20 09:18:23.128112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 352/715] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:22 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:23.133034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:23.134788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:23.136254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b23db428-a859-409e-b5db-339fd418f306 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.288242 Jul 20 09:18:23.136977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 364/716] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:22 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:24.144081 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:24.144704 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:24.151248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:24.151881 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:24.159858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:24.159858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:24.166035 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:24.170767 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:24.179225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:24.179689 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:24.183007 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:24.184438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:24.398968 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:24.407447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:24.408745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1f620e69-f1cb-459f-8382-d98afd8efcb6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1362 microversion: 2.1 time: 0.268937 Jul 20 09:18:24.409387 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 353/717] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:24 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:24.425078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:24.426936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:24.428365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4229f58e-95c0-4c64-ab02-d351723ddcbd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.276389 Jul 20 09:18:24.432541 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 365/718] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:24 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:25.431109 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:25.431849 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:25.434506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:25.440913 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:25.441686 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:25.442707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:25.443335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:25.449311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:25.450498 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:25.460248 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:25.463663 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:25.464633 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:25.466573 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:25.700304 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:25.714149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:25.715714 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:25.717209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-cadcb6f7-dc57-4b0d-bfb8-f7953b485396 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.272003 Jul 20 09:18:25.718991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 366/719] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:25 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:25.739184 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:25.747821 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ab231202-6c89-4ee5-9e38-d3cb06e1eca6 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1547 microversion: 2.1 time: 0.326163 Jul 20 09:18:25.748418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 354/720] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:18:25 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1547 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:18:25.765365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:25.765781 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:25.773231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:25.773995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:25.775109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:25.775800 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:25.875772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3adcc67f-cc37-49aa-ac1f-e649aa458792 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114182 Jul 20 09:18:25.879034 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 367/721] 10.222.0.44 () {58 vars in 1274 bytes} [Wed Jul 20 09:18:25 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:26.739639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:26.740245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:26.753989 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:26.755882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:26.756901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:26.757556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:26.951016 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:26.959910 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:26.961452 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:26.962631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b2ef92cd-926c-45f5-879f-c2baec339e27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.226905 Jul 20 09:18:26.964859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 355/722] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:26 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 20 09:18:27.201948 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-5696540e-25d1-418a-8fe7-022777f5577a req-ed4fe5df-9711-48a8-831f-bd573b172d91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1f6226c-6db8-4dc7-9666-36be348f5773", "tag": "8ef4dc8c-6218-451a-9f87-a8a34a78700a"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:27.212099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-5696540e-25d1-418a-8fe7-022777f5577a req-ed4fe5df-9711-48a8-831f-bd573b172d91 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:27.212561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-5696540e-25d1-418a-8fe7-022777f5577a req-ed4fe5df-9711-48a8-831f-bd573b172d91 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:27.225185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-5696540e-25d1-418a-8fe7-022777f5577a req-ed4fe5df-9711-48a8-831f-bd573b172d91 service nova] Creating event network-changed:8ef4dc8c-6218-451a-9f87-a8a34a78700a for instance a1f6226c-6db8-4dc7-9666-36be348f5773 on hv-cinder-84330 Jul 20 09:18:27.230419 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-5696540e-25d1-418a-8fe7-022777f5577a req-ed4fe5df-9711-48a8-831f-bd573b172d91 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220787 Jul 20 09:18:27.231375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 368/723] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:27.982441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:27.984429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:28.002517 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:28.004342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:28.005147 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:28.006886 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:28.240643 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:28.255613 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:28.257532 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:28.259045 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8edf43da-9a39-4950-b647-5b20b090c90a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.280375 Jul 20 09:18:28.276660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 356/724] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:27 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:29.284152 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:29.284849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:29.297645 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:29.298003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:29.298816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:29.299512 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:29.463431 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:29.474309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:29.475938 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:29.477170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6173b14d-870a-4171-9064-e9406299a115 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.198275 Jul 20 09:18:29.478407 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 369/725] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:29 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:30.497149 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:30.497804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:30.505255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:30.505720 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:30.506506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:30.507051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:30.638134 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:30.646327 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:30.647883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:30.649087 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-18b57232-8602-439b-ab1a-cc31785697d1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1739 microversion: 2.20 time: 0.156121 Jul 20 09:18:30.649650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 357/726] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:30 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:31.668760 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:31.669422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:31.676305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:31.676762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:31.677552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:31.677988 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:31.811608 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:31.821493 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:31.823029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:31.824176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c3232773-438c-4eca-aec8-982e7130643c tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1721 microversion: 2.20 time: 0.159377 Jul 20 09:18:31.825032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 370/727] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:31 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:32.842455 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:32.843598 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:32.850557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:32.851044 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:32.851815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:32.852258 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:32.986550 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:32.994467 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:32.996064 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:32.997224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e1650f40-b73d-4b9d-afc5-be8989069459 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1721 microversion: 2.20 time: 0.158703 Jul 20 09:18:32.997784 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 358/728] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:32 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:34.015648 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:34.016249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:34.022744 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.023200 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.023967 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.024410 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.157323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:34.165665 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:34.167183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:34.168333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-84b518ba-a3c1-4ce3-bf9e-a99a3f24a241 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1664 microversion: 2.20 time: 0.156896 Jul 20 09:18:34.168891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 371/729] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:34 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:34.186246 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f85e048-9752-4763-8d0b-af2e7f91fa23"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:34.188593 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:34.195226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.195675 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.196433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.196869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.471064 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-259c6b07-08ba-4271-a48b-e7c8905fd48b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.288665 Jul 20 09:18:34.471659 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 359/730] 10.222.0.44 () {62 vars in 1363 bytes} [Wed Jul 20 09:18:34 2022] POST /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-volume_attachments => generated 188 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 20 09:18:34.606210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:34.606826 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:34.608995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:34.614519 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.615066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.615901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.616557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.785331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-f3792198-7f71-4816-b24d-62ba4901a334 req-5082fb98-b6ce-413d-afb6-3098d876d4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "name": "network-vif-unplugged", "status": "completed", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:34.794179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f3792198-7f71-4816-b24d-62ba4901a334 req-5082fb98-b6ce-413d-afb6-3098d876d4cb service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.794620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-f3792198-7f71-4816-b24d-62ba4901a334 req-5082fb98-b6ce-413d-afb6-3098d876d4cb service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.804911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.compute.server_external_events [req-f3792198-7f71-4816-b24d-62ba4901a334 req-5082fb98-b6ce-413d-afb6-3098d876d4cb service nova] Unable to find a host for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649. Dropping event network-vif-unplugged {{(pid=117871) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 20 09:18:34.805808 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-f3792198-7f71-4816-b24d-62ba4901a334 req-5082fb98-b6ce-413d-afb6-3098d876d4cb service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.159246 Jul 20 09:18:34.806381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 360/731] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 160 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 20 09:18:34.895309 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-09887947-975e-4beb-bf82-78a4b9c366b9 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-volume_attachments/7f85e048-9752-4763-8d0b-af2e7f91fa23" status: 202 len: 0 microversion: 2.20 time: 0.292438 Jul 20 09:18:34.896864 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 372/732] 10.222.0.44 () {60 vars in 1456 bytes} [Wed Jul 20 09:18:34 2022] DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-volume_attachments/7f85e048-9752-4763-8d0b-af2e7f91fa23 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:18:34.956696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:34.957296 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:34.963342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.963793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:34.964548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:34.964983 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:35.058297 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-19387852-d943-40ae-a0d2-b349e9d2a54a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "POST /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/action" status: 202 len: 0 microversion: 2.20 time: 0.106309 Jul 20 09:18:35.059215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 361/733] 10.222.0.44 () {62 vars in 1318 bytes} [Wed Jul 20 09:18:34 2022] POST /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 20 09:18:35.067470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:35.068260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:35.075808 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:35.076466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:35.077147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:35.077723 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:35.245879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:35.254218 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:35.255769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:35.256966 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bccde9ee-9b9d-4b57-a950-5d0dc8b4be33 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1672 microversion: 2.20 time: 0.193356 Jul 20 09:18:35.257529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 373/734] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:35 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:36.277017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:36.277633 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:36.283736 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:36.284181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:36.284941 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:36.285375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:36.432883 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:36.441708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:36.443251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:36.444410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d96c7242-e5e4-4ded-8330-86922fb6f98a tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.171820 Jul 20 09:18:36.444974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 362/735] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:36 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:37.463174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:37.463965 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:37.472258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:37.473060 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:37.474111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:37.474627 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:37.634304 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:37.642870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:37.644507 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:37.645939 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1abaeafe-aa4b-4321-9e0c-d30ae4afef16 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.186634 Jul 20 09:18:37.646502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 374/736] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:37 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:38.665347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:38.665972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:38.673795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:38.674247 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:38.675073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:38.675824 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:38.815491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:38.824355 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:38.826132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:38.827451 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6567d21a-dd16-4e00-9f53-1634b2284e82 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.166409 Jul 20 09:18:38.828012 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 363/737] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:38 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:39.846193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:39.846765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:39.853192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:39.853648 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:39.854414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:39.854886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:40.011887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:40.014129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:40.022496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:40.024729 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:40.027064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d041ae65-98d7-47c8-b8fd-a3b733de5966 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.184348 Jul 20 09:18:40.027064 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 375/738] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:39 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:41.045663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:41.047120 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:41.053281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:41.053727 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:41.054479 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:41.054939 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:41.057419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:41.221260 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:41.230747 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:41.232331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:41.234378 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e7ca680b-187d-41ba-bb6a-b1d9101c43f8 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.191713 Jul 20 09:18:41.235248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 364/739] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:41 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:42.256019 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:42.256869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:42.264518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:42.266083 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:42.266911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:42.267354 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:42.462102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:42.472527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:42.474089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:42.475697 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c97726cc-3ad0-49c8-a9e7-d5d4fe4c2d4b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.227077 Jul 20 09:18:42.477470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 376/740] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:42 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:43.493119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:43.493749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:43.500969 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:43.501427 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:43.502199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:43.502637 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:43.649545 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:43.674801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:43.676438 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:43.677689 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-507ebb6b-577f-484a-a06a-12a98ed225cd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.188439 Jul 20 09:18:43.680249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 365/741] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:43 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:44.703671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:44.703671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:44.705184 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:44.705184 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:44.706891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:44.706891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:44.844838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:44.853325 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:44.855296 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:44.856735 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5f9dc581-0b3e-4d83-95eb-bae89acd8961 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.164246 Jul 20 09:18:44.857804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 377/742] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:44 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:45.876098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:45.876707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:45.883399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:45.883848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:45.884605 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:45.885038 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:46.020680 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:46.028765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:46.030855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:46.032032 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dee5a247-80a3-4be0-a4ab-80b475362863 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.160155 Jul 20 09:18:46.032594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 366/743] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:45 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:47.049536 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:47.050262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:47.057928 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:47.058374 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:47.059185 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:47.059619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:47.193916 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:47.202393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:47.203947 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:47.205101 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-592731c4-a5f4-40a2-8ae7-a78913d2b089 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.159597 Jul 20 09:18:47.205661 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 378/744] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:47 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:48.223310 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:48.223966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:48.230456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:48.230937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:48.231697 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:48.232136 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:48.368949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:48.376935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:48.378442 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:48.379619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3ff1d97f-8feb-4b36-b79a-0f7b1e8f6e56 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.160304 Jul 20 09:18:48.380171 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 367/745] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:48 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:49.399166 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:49.399816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:49.407679 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:49.408128 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:49.409338 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:49.409770 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:49.543436 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:49.552181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:49.554116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:49.554886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-99b12e9a-5cb0-4a81-b96d-87779d6f38ae tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.161001 Jul 20 09:18:49.555454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 379/746] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:49 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:50.012379 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:50.012905 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:50.020160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:50.020611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:50.021375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:50.021811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:50.048517 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-36aefa0e-6e41-44ae-98f4-a0ba13fec1ed tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/ips" status: 200 len: 149 microversion: 2.1 time: 0.041067 Jul 20 09:18:50.049089 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 368/747] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:18:50 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:18:50.572896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:50.573513 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:50.580458 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:50.580912 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:50.581677 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:50.582115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:50.713102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:50.721080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:50.722611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:50.723798 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-baa074aa-4e08-4c9e-a842-09f6fb4a67c1 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.154866 Jul 20 09:18:50.724369 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 380/748] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:50 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:51.742757 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:51.743370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:51.749934 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:51.750376 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:51.751166 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:51.751600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:51.917286 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:51.927878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:51.929494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:51.930655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-30d7fb2b-b4f7-49d5-a342-e83dc4f15c27 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.191905 Jul 20 09:18:51.931243 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 369/749] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:51 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:52.949274 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:52.950176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:52.956839 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:52.957295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:52.958063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:52.958506 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:53.084572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:53.092893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:53.094527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:53.095696 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-60c1be04-be6e-4fe0-8ca1-800b66027457 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.150352 Jul 20 09:18:53.096260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 381/750] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:52 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:54.113339 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:54.113958 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:54.120690 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:54.121151 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:54.121927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:54.122369 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:54.254743 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:54.262699 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:54.264283 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:54.265452 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-67217fdd-3df5-465a-ab74-b7451130f35d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.156031 Jul 20 09:18:54.266013 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 370/751] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:54 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:55.282834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:55.283460 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:55.289913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:55.290365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:55.291197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:55.291641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:55.411952 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-1f15a8ba-8bc8-4f4b-96af-97e4f58ca745 req-f8a218aa-7cb6-4ac8-8727-e8e0ac8c299b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "name": "network-vif-plugged", "status": "completed", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:55.422038 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1f15a8ba-8bc8-4f4b-96af-97e4f58ca745 req-f8a218aa-7cb6-4ac8-8727-e8e0ac8c299b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:55.422729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1f15a8ba-8bc8-4f4b-96af-97e4f58ca745 req-f8a218aa-7cb6-4ac8-8727-e8e0ac8c299b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:55.435926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-1f15a8ba-8bc8-4f4b-96af-97e4f58ca745 req-f8a218aa-7cb6-4ac8-8727-e8e0ac8c299b service nova] Creating event network-vif-plugged:21c8f316-fca3-4e77-88cd-b93181b283cf for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 on hv-cinder-84330 Jul 20 09:18:55.441216 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:55.447852 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-1f15a8ba-8bc8-4f4b-96af-97e4f58ca745 req-f8a218aa-7cb6-4ac8-8727-e8e0ac8c299b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039671 Jul 20 09:18:55.448970 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 371/752] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:18:55.451681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:55.453869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:55.455100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1e8dcb72-7d43-44cb-9e29-d38b1c82a4e6 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.176357 Jul 20 09:18:55.455664 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 382/753] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:55 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:55.587128 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e685a1f4-372f-4536-be46-5ae0c99c05d1"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:18:55.588463 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:55.590416 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=38 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:18:55.596242 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:55.596691 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:55.597471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:55.598028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:56.032814 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2b87cff6-b0b0-43c9-a904-51974f4a12a0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "POST /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.449825 Jul 20 09:18:56.033419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 372/754] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:18:55 2022] POST /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:18:56.474118 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:56.474771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:56.481242 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:56.481697 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:56.482472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:56.482940 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:56.622396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:56.632518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:56.634128 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:56.635410 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-aae449a1-045f-4bc3-ac3b-8d1455280355 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1730 microversion: 2.20 time: 0.165671 Jul 20 09:18:56.636104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 383/755] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:56 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:18:57.656491 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:18:57.657993 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:18:57.665241 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:57.665696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:57.666470 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:18:57.666934 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:18:57.797025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:57.805398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:57.807080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:18:57.808343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-82ebb914-5733-4529-b089-12f1780ca2dd tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1717 microversion: 2.20 time: 0.157561 Jul 20 09:18:57.809000 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 373/756] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:18:57 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1717 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:19:03.631818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:03.632315 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:03.639771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:03.640220 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:03.640993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:03.641427 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:03.723465 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lazy-loading 'services' on Instance uuid f22f4a54-447d-4e9b-89a8-aeb524a9db9c {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:19:03.800404 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-64b4383b-e694-49eb-bab0-1b5e2d8d3e1b tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments/e685a1f4-372f-4536-be46-5ae0c99c05d1" status: 202 len: 0 microversion: 2.1 time: 0.172365 Jul 20 09:19:03.801013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 384/757] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:19:03 2022] DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments/e685a1f4-372f-4536-be46-5ae0c99c05d1 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:19:03.809482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:03.810526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:03.817797 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:03.818238 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:03.819050 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:03.820752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:03.853035 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d3db3a73-8aa5-4ae1-9d94-b194c500ecb2 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Jul 20 09:19:03.853590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 374/758] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:19:03 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:04.865971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:04.867113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:04.869024 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=26 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:04.875112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:04.875557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:04.876320 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:04.876752 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:04.905295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0a63ef94-3842-4ad1-a8be-6744f04dfb06 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044100 Jul 20 09:19:04.905838 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 385/759] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:19:04 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:19:04.963920 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:04.964435 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:04.971254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:04.971714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:04.972483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:04.972972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:05.000061 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:19:05.084255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d11c6471-3d50-4bb3-b353-241b7b3317fd tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 204 len: 0 microversion: 2.1 time: 0.123880 Jul 20 09:19:05.084981 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 375/760] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:04 2022] DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:19:05.093973 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:05.094580 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:05.100754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:05.101210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:05.101979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:05.102413 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:05.229999 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:05.237819 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f9ea7d7c-78a1-4b4e-a10c-cd498d4f9fd8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1680 microversion: 2.1 time: 0.148286 Jul 20 09:19:05.238582 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 386/761] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:05 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1680 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:06.255837 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:06.256548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:06.263187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:06.263639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:06.264924 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:06.265362 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:06.399275 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:06.407315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b6b7183c-b35f-4f07-8e1f-0d7732309094 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1680 microversion: 2.1 time: 0.156030 Jul 20 09:19:06.407879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 376/762] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:06 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:07.424782 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:07.425402 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:07.431706 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:07.432533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:07.433359 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:07.433976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:07.510265 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-9b7ca8e2-7370-4cbd-9d62-1da00ae6e8f9 req-c00c5d78-a37d-46ec-8fb4-60a5298c7a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f22f4a54-447d-4e9b-89a8-aeb524a9db9c", "name": "network-vif-deleted", "tag": "d592f7bf-83b9-4028-823b-5edc19de7a73"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:07.520531 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-9b7ca8e2-7370-4cbd-9d62-1da00ae6e8f9 req-c00c5d78-a37d-46ec-8fb4-60a5298c7a6a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:07.521452 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-9b7ca8e2-7370-4cbd-9d62-1da00ae6e8f9 req-c00c5d78-a37d-46ec-8fb4-60a5298c7a6a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:07.533766 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-9b7ca8e2-7370-4cbd-9d62-1da00ae6e8f9 req-c00c5d78-a37d-46ec-8fb4-60a5298c7a6a service nova] Creating event network-vif-deleted:d592f7bf-83b9-4028-823b-5edc19de7a73 for instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c on hv-cinder-84330 Jul 20 09:19:07.534010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a020687e95a40f88d521757d8b25619', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94fff07a1fa347b2b5ff853a2c4f1a1a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:07.545007 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-9b7ca8e2-7370-4cbd-9d62-1da00ae6e8f9 req-c00c5d78-a37d-46ec-8fb4-60a5298c7a6a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038579 Jul 20 09:19:07.552944 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bf394f25-7595-4417-aa7f-cf3ab6d62097 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 200 len: 1612 microversion: 2.1 time: 0.132088 Jul 20 09:19:07.554332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 377/763] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:07.555812 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 387/764] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:07 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 1612 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:08.574411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:08.576370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:08.582857 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:08.583312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:08.584080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:08.584632 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:08.602239 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c HTTP/1.1 Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:08.603898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:08.605377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'f22f4a54-447d-4e9b-89a8-aeb524a9db9c'} Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:08.606158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:08.608048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:08.609229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:08.609229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b68a0c2e-f131-4a6a-95b7-a7439517ced8 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 404 len: 111 microversion: 2.1 time: 0.036157 Jul 20 09:19:08.609229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 378/765] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:08 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:08.615337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a7329874-9703-4f49-ab0f-023321149443 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '.version_select at 0x7fadafa829d0>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:08.635559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a7329874-9703-4f49-ab0f-023321149443 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-708946796" status: 202 len: 0 microversion: 2.1 time: 0.023916 Jul 20 09:19:08.637294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 388/766] 10.222.0.44 () {58 vars in 1217 bytes} [Wed Jul 20 09:19:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-708946796 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:19:10.502647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:10.503179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:10.509588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:10.510040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:10.510836 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:10.511280 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:10.525386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c HTTP/1.1 Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:10.526942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.528506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'f22f4a54-447d-4e9b-89a8-aeb524a9db9c'} Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:10.529563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.531394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.533003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:10.533003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a0aeaa93-0a81-4708-a604-972c816247bf tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 404 len: 111 microversion: 2.1 time: 0.030767 Jul 20 09:19:10.533003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 379/767] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:10 2022] DELETE /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:10.537723 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:10.538340 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: f22f4a54-447d-4e9b-89a8-aeb524a9db9c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:10.545324 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:10.545985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:10.547035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:10.547506 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:10.563613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c HTTP/1.1 Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:10.565293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.566725 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'f22f4a54-447d-4e9b-89a8-aeb524a9db9c'} Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:10.567497 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. Jul 20 09:19:10.568702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:10.569775 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance f22f4a54-447d-4e9b-89a8-aeb524a9db9c could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:10.569775 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-23990d36-ffcf-4f12-8423-4c84f176d041 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c" status: 404 len: 111 microversion: 2.1 time: 0.033364 Jul 20 09:19:10.569775 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 389/768] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:10 2022] GET /compute/v2.1/servers/f22f4a54-447d-4e9b-89a8-aeb524a9db9c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:11.705742 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:11.706326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:11.713051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.713718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.714817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.716382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.721017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:11.737858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 HTTP/1.1 Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:11.739798 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.741219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '0a5f5238-e5de-4c38-b0df-42903cdf8bd5'} Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:11.741950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.743169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.744381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:11.744381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b098503d-b5ae-474f-8c42-a49c4583bc9f tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 404 len: 111 microversion: 2.1 time: 0.040667 Jul 20 09:19:11.744381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 380/769] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:11 2022] DELETE /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:11.750965 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:11.751610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: 0a5f5238-e5de-4c38-b0df-42903cdf8bd5] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:11.758787 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.759324 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.760172 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.760678 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.775115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 HTTP/1.1 Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:11.776865 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.778552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '0a5f5238-e5de-4c38-b0df-42903cdf8bd5'} Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:11.780067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. Jul 20 09:19:11.781312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.782376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance 0a5f5238-e5de-4c38-b0df-42903cdf8bd5 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:11.782376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-898736a6-67b7-4460-bc9c-a257778a7bba tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5" status: 404 len: 111 microversion: 2.1 time: 0.032046 Jul 20 09:19:11.783079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 390/770] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:11 2022] GET /compute/v2.1/servers/0a5f5238-e5de-4c38-b0df-42903cdf8bd5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:11.788418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:11.788927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:11.796024 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.796486 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.797272 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.797718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.811949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f HTTP/1.1 Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:11.813673 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.815215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'e7d376e6-8b18-47e6-a0d3-d77f6b6e355f'} Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:11.816139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.817494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.819371 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:11.819371 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1e17c62b-e476-4e88-a93a-63ce1d37f311 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 404 len: 111 microversion: 2.1 time: 0.031069 Jul 20 09:19:11.819371 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 381/771] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:11 2022] DELETE /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:19:11.823976 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:11.824589 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: e7d376e6-8b18-47e6-a0d3-d77f6b6e355f] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:11.831051 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.831496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.832249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:11.832680 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:11.849357 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f HTTP/1.1 Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:11.850906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.852277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'e7d376e6-8b18-47e6-a0d3-d77f6b6e355f'} Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:11.853010 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. Jul 20 09:19:11.854381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:11.855885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance e7d376e6-8b18-47e6-a0d3-d77f6b6e355f could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:11.855885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7aa8958c-ad2e-4db6-8d70-0ddac1552b1c tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f" status: 404 len: 111 microversion: 2.1 time: 0.032258 Jul 20 09:19:11.855885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 391/772] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:11 2022] GET /compute/v2.1/servers/e7d376e6-8b18-47e6-a0d3-d77f6b6e355f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:19:12.913899 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:12.914432 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:12.921538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:12.921997 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:12.922804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:12.923252 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:12.947181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-458ac86f-2922-482b-840b-b9f5644d05c5 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/ips" status: 200 len: 145 microversion: 2.1 time: 0.037040 Jul 20 09:19:12.947755 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 382/773] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:19:12 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:13.072854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:13.073398 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:13.080443 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:13.081098 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:13.082078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:13.082595 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:13.087000 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:13.100745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 HTTP/1.1 Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:13.103189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.105081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'ec129daf-9e04-4ed9-bd69-a27ebf04ed38'} Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:13.106104 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.107995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.110936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:13.112100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-39ba27ce-bef6-41c7-8a34-dc8c919033c0 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 404 len: 111 microversion: 2.1 time: 0.044674 Jul 20 09:19:13.113334 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 392/774] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:13 2022] DELETE /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 20 09:19:13.120895 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:13.121710 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] [instance: ec129daf-9e04-4ed9-bd69-a27ebf04ed38] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:13.128520 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:13.129143 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:13.130011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:13.130846 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:13.154769 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] HTTP exception thrown: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Request method failure captured: Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 HTTP/1.1 Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cUM8sOGuCaNRJkDfyKNai4tDrk63uTuUo6srCx_XLFSy8Nm1jcvChLCMZJGjOSrmkRPjWBKGXnPLKCEmLbw-EsJOKDLcKgMysTO9gYx-r-wYGgMk0qn94F9FZwgKuzsmlcstiojxKIrrevOMhcgOeUnKA-5UfXElV8WYGY7_ovrUg Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:13.156321 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/94fff07a1fa347b2b5ff853a2c4f1a1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 94fff07a1fa347b2b5ff853a2c4f1a1a Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-866873044 Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 9a020687e95a40f88d521757d8b25619 Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeNegativeTest-866873044-project Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.157991 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'ec129daf-9e04-4ed9-bd69-a27ebf04ed38'} Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:13.159107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. Jul 20 09:19:13.160478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:13.161751 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] Returning 404 to user: Instance ec129daf-9e04-4ed9-bd69-a27ebf04ed38 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:13.161751 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f708587d-0f3f-4d56-b15a-90e0ad09bc75 tempest-AttachVolumeNegativeTest-866873044 tempest-AttachVolumeNegativeTest-866873044-project] 10.222.0.44 "GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38" status: 404 len: 111 microversion: 2.1 time: 0.040667 Jul 20 09:19:13.166853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 383/775] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:13 2022] GET /compute/v2.1/servers/ec129daf-9e04-4ed9-bd69-a27ebf04ed38 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:14.340926 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6a40720-561a-45d8-a474-b55c4089ad00"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:14.341969 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:14.349611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:14.350072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:14.350906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:14.351359 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:14.624448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d4183da3-b5cb-4d56-a75a-1e5d12f9a444 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286234 Jul 20 09:19:14.625100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 393/776] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:19:14 2022] POST /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:23.582179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:23.584028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:23.591131 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:23.592399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=9 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:23.596126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:23.596832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:23.598068 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:23.598660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:23.638553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-edd2d402-dbab-4947-ac14-d64f46d27946 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060939 Jul 20 09:19:23.639915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 384/777] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:19:23 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:23.656255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:23.656883 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:23.667844 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:23.668302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:23.675040 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:23.675869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:23.721381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-eb34395b-92db-4ce5-bfbe-879e13a71fba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/b6a40720-561a-45d8-a474-b55c4089ad00" status: 200 len: 194 microversion: 2.1 time: 0.073847 Jul 20 09:19:23.723458 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 394/778] 10.222.0.44 () {58 vars in 1412 bytes} [Wed Jul 20 09:19:23 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/b6a40720-561a-45d8-a474-b55c4089ad00 => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:25.192879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5ff90615-0ddf-49a0-9483-726f8ff06376"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:25.197816 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:25.215537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:25.218545 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:25.219563 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:25.220132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:25.618819 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5c1c0211-6031-431b-8c42-b6bc19680be8 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "POST /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.435566 Jul 20 09:19:25.620098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 385/779] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:19:25 2022] POST /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments => generated 194 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:32.459548 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:32.460488 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:32.469049 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:32.469892 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:32.470882 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:32.471518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:32.517879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f4327011-0bfa-4073-91c3-4d1296116efb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062258 Jul 20 09:19:32.523731 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 395/780] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:19:32 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:32.658646 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:32.659426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:32.666172 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:32.666945 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:32.667893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:32.668333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:32.708788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ecca3cb6-3037-480c-8478-14b57b3f5c5b tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/b6a40720-561a-45d8-a474-b55c4089ad00" status: 200 len: 194 microversion: 2.1 time: 0.055146 Jul 20 09:19:32.709149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 396/781] 10.222.0.44 () {58 vars in 1412 bytes} [Wed Jul 20 09:19:32 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/b6a40720-561a-45d8-a474-b55c4089ad00 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:19:32.722749 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:32.723253 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:32.729568 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:32.730016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:32.731002 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:32.731436 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:32.785493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-782f4951-0ce8-4780-ba8c-174cf66345b4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Action: 'create', calling method: .version_select at 0x7fadbc2719d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1964681893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD05oR9PhZf2Qvano5s7eZ0K+AmL5SBjBDcv+2/e+U84P6Ds5dX9qTJczplIrMZbPkEiXHEZMzNwx9UU3mdpnw1LxdX6aEbS29G16g8TSDbRgSXY9fvAELan8QMBaN9qjQ=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:32.801580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-782f4951-0ce8-4780-ba8c-174cf66345b4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Getting quotas for project e6a9958d940546b99e37b85acc95ad7c. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:19:32.805456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-782f4951-0ce8-4780-ba8c-174cf66345b4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Getting quotas for user bcc742eb9e7b42d9bb41f04bb58038db and project e6a9958d940546b99e37b85acc95ad7c. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:19:32.819485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lazy-loading 'services' on Instance uuid a1f6226c-6db8-4dc7-9666-36be348f5773 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:19:32.828696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-782f4951-0ce8-4780-ba8c-174cf66345b4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.262313 Jul 20 09:19:32.829312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 386/782] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:19:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:32.904167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e2fba321-2b1e-46a0-b8b9-b657a6e5cff9 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/b6a40720-561a-45d8-a474-b55c4089ad00" status: 202 len: 0 microversion: 2.1 time: 0.189037 Jul 20 09:19:32.906923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 397/783] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:19:32 2022] DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/b6a40720-561a-45d8-a474-b55c4089ad00 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:19:34.039879 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:34.040529 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:34.050552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:34.051478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:34.052277 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:34.052725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:34.085856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3df799bf-0633-4868-bfc3-bb446174afdd tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/5ff90615-0ddf-49a0-9483-726f8ff06376" status: 200 len: 194 microversion: 2.1 time: 0.049923 Jul 20 09:19:34.086473 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 387/784] 10.222.0.44 () {58 vars in 1412 bytes} [Wed Jul 20 09:19:34 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/5ff90615-0ddf-49a0-9483-726f8ff06376 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:34.097794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:34.098377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:34.104922 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:34.105375 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:34.106138 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:34.106778 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:34.195252 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lazy-loading 'services' on Instance uuid a1f6226c-6db8-4dc7-9666-36be348f5773 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:19:34.273887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9e140c6f-d581-42f8-958d-36f9bfc31c69 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/5ff90615-0ddf-49a0-9483-726f8ff06376" status: 202 len: 0 microversion: 2.1 time: 0.180947 Jul 20 09:19:34.274652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 398/785] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:19:34 2022] DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments/5ff90615-0ddf-49a0-9483-726f8ff06376 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:19:35.478981 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:35.493186 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:35.503957 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:35.504411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:35.505200 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:35.505639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:35.563452 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c99ce1c4-ce0c-41a6-8577-0a75e7369d62 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091563 Jul 20 09:19:35.564478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 388/786] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:19:35 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:19:35.693951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:35.695885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:35.704213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:35.708099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:35.708099 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:35.709072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:35.709482 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:35.746602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7831be76-2d8e-417f-8e31-d9aa12bef784 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058391 Jul 20 09:19:35.747837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 399/787] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:19:35 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:19:35.840113 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:35.840613 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:35.850005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:35.850583 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:35.854415 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:35.854912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:35.905373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:19:36.035922 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cb731ec1-c838-4487-8a6e-95c9c21650ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 204 len: 0 microversion: 2.1 time: 0.199507 Jul 20 09:19:36.037354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 389/788] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:35 2022] DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:19:36.046591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:36.047333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:36.055372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.056085 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.056867 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.057462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.208564 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:36.216344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8f9f23e4-9c1a-4ca2-9890-cdc9b2b0b3ba tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1672 microversion: 2.1 time: 0.174196 Jul 20 09:19:36.217297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 400/789] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:36 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1672 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:36.562386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:36.563557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:36.570553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.571263 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.572125 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.572558 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.608377 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4cd71a9f-527f-4e5e-b57d-a3d838dc5621 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050207 Jul 20 09:19:36.613831 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 390/790] 10.222.0.44 () {60 vars in 1342 bytes} [Wed Jul 20 09:19:36 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:36.675850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:36.676368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:36.682657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.683144 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.683927 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.684374 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.715562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:19:36.797327 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c9a037c3-c725-4c8e-97ba-2030a2d016c4 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 204 len: 0 microversion: 2.20 time: 0.125283 Jul 20 09:19:36.797923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 401/791] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jul 20 09:19:36 2022] DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:19:36.806079 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:36.806709 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:36.813711 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.814531 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.815453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:36.815968 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:36.955326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:36.966835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:36.969145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:36.970338 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-da24cad7-070e-458a-8e1d-0a2b4820cc31 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.168118 Jul 20 09:19:36.970954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 391/792] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:36 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:19:37.236457 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:37.237082 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:37.243240 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:37.243718 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:37.244682 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:37.245119 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:37.411886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:37.419722 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-679054e2-6d1b-4143-ad74-ef8a419ef3c7 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1672 microversion: 2.1 time: 0.188976 Jul 20 09:19:37.421115 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 402/793] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:37 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1672 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:37.989228 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:37.990035 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:37.997452 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:37.998019 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:37.998849 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:37.999288 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:38.203107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:38.213650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:38.215428 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:38.216672 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e9511a29-4b52-4f7d-ac04-d3618fe2d546 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.231261 Jul 20 09:19:38.217853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 392/794] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:37 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:19:38.437437 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:38.438063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:38.445165 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:38.445951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:38.447029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:38.447546 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:38.606303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:38.614717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1a238542-3e23-46fe-8ab0-b1ec209ed65d tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1672 microversion: 2.1 time: 0.181000 Jul 20 09:19:38.617539 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 403/795] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:38 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1672 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:39.235986 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:39.237164 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:39.243459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:39.244160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:39.245183 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:39.245845 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:39.440443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:39.454036 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:39.455708 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:39.457254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e34440f8-e3d2-4c1e-b567-82f88ecc3e08 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1723 microversion: 2.20 time: 0.225670 Jul 20 09:19:39.457809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 393/796] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:39 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:19:39.634641 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:39.635277 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:39.644192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:39.644919 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:39.645955 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:39.646617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:39.957341 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:39.966804 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-605fce58-a0c0-45e1-a00d-4f29942371a4 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1672 microversion: 2.1 time: 0.336876 Jul 20 09:19:39.983911 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 404/797] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:39 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1672 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:40.477167 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:40.477897 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:40.487205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:40.488042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:40.491391 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:40.492312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:40.605373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:40.624399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:40.626698 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f0547075e10c498b8d13e1859197cea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '752497421a0b4c70a08bcca4393b8837', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:40.628245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7a4b3f5c-f42a-4eaf-9435-52fccdc8e98d tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 200 len: 1655 microversion: 2.20 time: 0.156622 Jul 20 09:19:40.640738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 394/798] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:40 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 1655 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 20 09:19:40.771794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-99aa2482-ca11-4e3b-93e4-1aafb2f45b92 req-9d898e07-e92f-4919-8ced-7fc84d5e8803 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1f6226c-6db8-4dc7-9666-36be348f5773", "name": "network-vif-deleted", "tag": "8ef4dc8c-6218-451a-9f87-a8a34a78700a"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:40.810266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-99aa2482-ca11-4e3b-93e4-1aafb2f45b92 req-9d898e07-e92f-4919-8ced-7fc84d5e8803 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:40.812979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-99aa2482-ca11-4e3b-93e4-1aafb2f45b92 req-9d898e07-e92f-4919-8ced-7fc84d5e8803 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:40.843081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:40.876996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-99aa2482-ca11-4e3b-93e4-1aafb2f45b92 req-9d898e07-e92f-4919-8ced-7fc84d5e8803 service nova] Creating event network-vif-deleted:8ef4dc8c-6218-451a-9f87-a8a34a78700a for instance a1f6226c-6db8-4dc7-9666-36be348f5773 on hv-cinder-84330 Jul 20 09:19:40.887967 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-99aa2482-ca11-4e3b-93e4-1aafb2f45b92 req-9d898e07-e92f-4919-8ced-7fc84d5e8803 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119559 Jul 20 09:19:40.895286 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 405/799] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:40.987087 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:40.988016 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:41.005976 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:41.006774 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:41.007746 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:41.008344 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:41.076066 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:41.077193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:41.077370 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lazy-loading 'fault' on Instance uuid a1f6226c-6db8-4dc7-9666-36be348f5773 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:19:41.149745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a3ed8bea97e49628311cb45d48ca699', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6476016c570542d3b00f9ed1507655da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:41.159513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1a458c8b-3715-45e2-b525-dc0099bbdc9e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 200 len: 1326 microversion: 2.1 time: 0.177808 Jul 20 09:19:41.160627 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 395/800] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:40 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 1326 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:41.649869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:41.650523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:41.658717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:41.659174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:41.659954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:41.660394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:41.676547 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] HTTP exception thrown: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Request method failure captured: Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 HTTP/1.1 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cVKSpBVrefenRGFmsXAwZwepWHYt4oJIJrF8BIyEHAygjw1hP0-E7k2yeL25UFSMJqXO14shgcz6kEsdTGm0mnLwJe9jB0c08Q8tAv0QV9BbuMRoig2Lc4GSScRG39c176dYl5LBTFotPEXWBO8w_rwHJVzwyoQayCBGFruLXaKME Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:41.678254 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_752497421a0b4c70a08bcca4393b8837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: f0547075e10c498b8d13e1859197cea0 Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:41.680035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '5e2a29ba-3d49-40ed-9086-5a9f73558649'} Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:41.684538 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:41.686984 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:41.688447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Returning 404 to user: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:41.688447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3784443f-387e-445d-bf2a-c5261dea1dbe tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 404 len: 111 microversion: 2.20 time: 0.035006 Jul 20 09:19:41.688447 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 406/801] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:41 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:19:41.692033 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b36aca04-84c5-460a-9e4c-9fab3c65330b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '.version_select at 0x7fadbc1f9550>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:41.709869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b36aca04-84c5-460a-9e4c-9fab3c65330b tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670667042" status: 204 len: 0 microversion: 2.20 time: 0.023647 Jul 20 09:19:41.710552 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 396/802] 10.222.0.44 () {60 vars in 1261 bytes} [Wed Jul 20 09:19:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1670667042 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 20 09:19:42.178841 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:42.180282 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:42.188763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:42.188928 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:42.189670 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:42.190390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:42.207957 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] HTTP exception thrown: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Request method failure captured: Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 HTTP/1.1 Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18do-FP05Ry6MAjUEPFWkvh4Uzu43hSRTwj1uoPeypXtSedRJ08AuH65StzvpmhRECko9oX9DgQr8TINCYeLgAxJW31ZGTrYtwtw8Jms18Zga0cPu8cHkvFt0ww9HQvTeDBNBOfL7eZemFV5U6oB_0XybWO024BN5STIN7WdI3CH5YE Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:42.209772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6476016c570542d3b00f9ed1507655da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6476016c570542d3b00f9ed1507655da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 0a3ed8bea97e49628311cb45d48ca699 Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:42.211411 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'a1f6226c-6db8-4dc7-9666-36be348f5773'} Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:42.212322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:42.213933 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:42.215452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Returning 404 to user: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:42.215452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c03dd72e-f357-4f4a-8505-06f64bb67fbf tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 404 len: 111 microversion: 2.1 time: 0.037422 Jul 20 09:19:42.215452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 407/803] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:42 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:42.222397 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3286949c-ccc2-4a1e-af7f-92b0ab8b9dbb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '.version_select at 0x7fadbc24a820>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:42.247480 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3286949c-ccc2-4a1e-af7f-92b0ab8b9dbb tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-27688704" status: 202 len: 0 microversion: 2.1 time: 0.028992 Jul 20 09:19:42.248073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 397/804] 10.222.0.44 () {58 vars in 1214 bytes} [Wed Jul 20 09:19:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-27688704 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:19:42.904258 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-4190f43a-0de9-498f-8cb3-8d5a1e72b76f req-f869edbc-d8fc-4f73-ad1d-44f027db8e09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2a29ba-3d49-40ed-9086-5a9f73558649", "name": "network-vif-deleted", "tag": "21c8f316-fca3-4e77-88cd-b93181b283cf"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:42.918392 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4190f43a-0de9-498f-8cb3-8d5a1e72b76f req-f869edbc-d8fc-4f73-ad1d-44f027db8e09 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:42.918886 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-4190f43a-0de9-498f-8cb3-8d5a1e72b76f req-f869edbc-d8fc-4f73-ad1d-44f027db8e09 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:42.930664 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-4190f43a-0de9-498f-8cb3-8d5a1e72b76f req-f869edbc-d8fc-4f73-ad1d-44f027db8e09 service nova] Creating event network-vif-deleted:21c8f316-fca3-4e77-88cd-b93181b283cf for instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 on hv-cinder-84330 Jul 20 09:19:42.935522 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-4190f43a-0de9-498f-8cb3-8d5a1e72b76f req-f869edbc-d8fc-4f73-ad1d-44f027db8e09 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035057 Jul 20 09:19:42.936380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 408/805] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:43.617867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:43.618406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:43.621700 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=4 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:43.628078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:43.628526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:43.629301 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:43.629741 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:43.644202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] HTTP exception thrown: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Request method failure captured: Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 HTTP/1.1 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cVKSpBVrefenRGFmsXAwZwepWHYt4oJIJrF8BIyEHAygjw1hP0-E7k2yeL25UFSMJqXO14shgcz6kEsdTGm0mnLwJe9jB0c08Q8tAv0QV9BbuMRoig2Lc4GSScRG39c176dYl5LBTFotPEXWBO8w_rwHJVzwyoQayCBGFruLXaKME Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:43.645908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_752497421a0b4c70a08bcca4393b8837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: f0547075e10c498b8d13e1859197cea0 Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.647579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '5e2a29ba-3d49-40ed-9086-5a9f73558649'} Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:43.648611 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.650127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.651670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Returning 404 to user: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:43.651670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cc90d7b3-8e2c-473f-bac1-1d0a8b734bbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 404 len: 111 microversion: 2.20 time: 0.033444 Jul 20 09:19:43.651670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 398/806] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jul 20 09:19:43 2022] DELETE /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:19:43.657109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:43.657835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 5e2a29ba-3d49-40ed-9086-5a9f73558649] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:43.664614 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:43.665062 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:43.665840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:43.666279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:43.679807 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] HTTP exception thrown: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Request method failure captured: Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 HTTP/1.1 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cVKSpBVrefenRGFmsXAwZwepWHYt4oJIJrF8BIyEHAygjw1hP0-E7k2yeL25UFSMJqXO14shgcz6kEsdTGm0mnLwJe9jB0c08Q8tAv0QV9BbuMRoig2Lc4GSScRG39c176dYl5LBTFotPEXWBO8w_rwHJVzwyoQayCBGFruLXaKME Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:43.681578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_752497421a0b4c70a08bcca4393b8837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: f0547075e10c498b8d13e1859197cea0 Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.683215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '5e2a29ba-3d49-40ed-9086-5a9f73558649'} Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:43.684009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. Jul 20 09:19:43.685691 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:43.687801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Returning 404 to user: Instance 5e2a29ba-3d49-40ed-9086-5a9f73558649 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:43.687801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-995a6b54-7865-48b0-8ee9-19e0e4bebfbb tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649" status: 404 len: 111 microversion: 2.20 time: 0.030762 Jul 20 09:19:43.687801 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 409/807] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:43 2022] GET /compute/v2.1/servers/5e2a29ba-3d49-40ed-9086-5a9f73558649 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:19:44.826148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:44.827406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:44.833665 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:44.834148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:44.834952 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:44.835398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:44.851615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] HTTP exception thrown: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Request method failure captured: Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c HTTP/1.1 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18cVKSpBVrefenRGFmsXAwZwepWHYt4oJIJrF8BIyEHAygjw1hP0-E7k2yeL25UFSMJqXO14shgcz6kEsdTGm0mnLwJe9jB0c08Q8tAv0QV9BbuMRoig2Lc4GSScRG39c176dYl5LBTFotPEXWBO8w_rwHJVzwyoQayCBGFruLXaKME Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:44.853172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_752497421a0b4c70a08bcca4393b8837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: f0547075e10c498b8d13e1859197cea0 Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.854841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '7ce2565b-0061-4f06-950a-4941d97bdc2c'} Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:44.855728 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.857901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.859499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Returning 404 to user: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:44.859499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-303d3895-6ad6-4766-8577-94217cc79919 tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 404 len: 111 microversion: 2.20 time: 0.032655 Jul 20 09:19:44.859499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 399/808] 10.222.0.44 () {60 vars in 1279 bytes} [Wed Jul 20 09:19:44 2022] DELETE /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:19:44.863173 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:44.863792 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] [instance: 7ce2565b-0061-4f06-950a-4941d97bdc2c] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:44.870307 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:44.870790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:44.871554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:44.871994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:44.886647 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] HTTP exception thrown: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Request method failure captured: Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c HTTP/1.1 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18cVKSpBVrefenRGFmsXAwZwepWHYt4oJIJrF8BIyEHAygjw1hP0-E7k2yeL25UFSMJqXO14shgcz6kEsdTGm0mnLwJe9jB0c08Q8tAv0QV9BbuMRoig2Lc4GSScRG39c176dYl5LBTFotPEXWBO8w_rwHJVzwyoQayCBGFruLXaKME Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Openstack-Nova-Api-Version: 2.20 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:44.888236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_752497421a0b4c70a08bcca4393b8837"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/752497421a0b4c70a08bcca4393b8837"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 752497421a0b4c70a08bcca4393b8837 Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-695162342 Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: f0547075e10c498b8d13e1859197cea0 Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeShelveTestJSON-695162342-project Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.889631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '7ce2565b-0061-4f06-950a-4941d97bdc2c'} Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:44.890475 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. Jul 20 09:19:44.893052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:44.894555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] Returning 404 to user: Instance 7ce2565b-0061-4f06-950a-4941d97bdc2c could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:44.894555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a75e0cde-5459-42cf-bf52-52faff1439fa tempest-AttachVolumeShelveTestJSON-695162342 tempest-AttachVolumeShelveTestJSON-695162342-project] 10.222.0.44 "GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c" status: 404 len: 111 microversion: 2.20 time: 0.030338 Jul 20 09:19:44.894555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 410/809] 10.222.0.44 () {60 vars in 1276 bytes} [Wed Jul 20 09:19:44 2022] GET /compute/v2.1/servers/7ce2565b-0061-4f06-950a-4941d97bdc2c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 20 09:19:45.572153 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:45.572749 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:45.579401 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:45.579935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:45.580899 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:45.582515 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:45.596982 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] HTTP exception thrown: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Request method failure captured: Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 HTTP/1.1 Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18do-FP05Ry6MAjUEPFWkvh4Uzu43hSRTwj1uoPeypXtSedRJ08AuH65StzvpmhRECko9oX9DgQr8TINCYeLgAxJW31ZGTrYtwtw8Jms18Zga0cPu8cHkvFt0ww9HQvTeDBNBOfL7eZemFV5U6oB_0XybWO024BN5STIN7WdI3CH5YE Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:45.598447 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6476016c570542d3b00f9ed1507655da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6476016c570542d3b00f9ed1507655da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 0a3ed8bea97e49628311cb45d48ca699 Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.599854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'a1f6226c-6db8-4dc7-9666-36be348f5773'} Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:45.600603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.601867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.603163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Returning 404 to user: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:45.603163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-11c81366-df72-4176-b389-1c04778edb8e tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 404 len: 111 microversion: 2.1 time: 0.031614 Jul 20 09:19:45.603163 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 400/810] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:45 2022] DELETE /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:45.608415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:45.609062 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: a1f6226c-6db8-4dc7-9666-36be348f5773] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:45.616242 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:45.616701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:45.617514 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:45.617960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:45.631561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] HTTP exception thrown: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Request method failure captured: Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 HTTP/1.1 Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18do-FP05Ry6MAjUEPFWkvh4Uzu43hSRTwj1uoPeypXtSedRJ08AuH65StzvpmhRECko9oX9DgQr8TINCYeLgAxJW31ZGTrYtwtw8Jms18Zga0cPu8cHkvFt0ww9HQvTeDBNBOfL7eZemFV5U6oB_0XybWO024BN5STIN7WdI3CH5YE Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:45.633096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6476016c570542d3b00f9ed1507655da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6476016c570542d3b00f9ed1507655da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 0a3ed8bea97e49628311cb45d48ca699 Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.634517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'a1f6226c-6db8-4dc7-9666-36be348f5773'} Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:45.635303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. Jul 20 09:19:45.636654 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:45.637738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Returning 404 to user: Instance a1f6226c-6db8-4dc7-9666-36be348f5773 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:45.637738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-66d561ae-5470-48b7-b547-188d601f551f tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773" status: 404 len: 111 microversion: 2.1 time: 0.029885 Jul 20 09:19:45.637738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 411/811] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:45 2022] GET /compute/v2.1/servers/a1f6226c-6db8-4dc7-9666-36be348f5773 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:46.777565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:46.778112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:46.785512 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:46.785962 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:46.786833 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:46.787274 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:46.802721 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] HTTP exception thrown: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Request method failure captured: Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a HTTP/1.1 Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18do-FP05Ry6MAjUEPFWkvh4Uzu43hSRTwj1uoPeypXtSedRJ08AuH65StzvpmhRECko9oX9DgQr8TINCYeLgAxJW31ZGTrYtwtw8Jms18Zga0cPu8cHkvFt0ww9HQvTeDBNBOfL7eZemFV5U6oB_0XybWO024BN5STIN7WdI3CH5YE Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:46.804270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6476016c570542d3b00f9ed1507655da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6476016c570542d3b00f9ed1507655da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 0a3ed8bea97e49628311cb45d48ca699 Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.805878 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'e25fa365-3e8d-4bf5-8914-9ed484c6754a'} Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:46.806762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.808159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.810063 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Returning 404 to user: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:46.811101 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-03215618-01fa-46ec-b033-408ee49d63c3 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 404 len: 111 microversion: 2.1 time: 0.038464 Jul 20 09:19:46.811655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 401/812] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:19:46 2022] DELETE /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:46.820247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:46.820870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] [instance: e25fa365-3e8d-4bf5-8914-9ed484c6754a] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:46.828078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:46.828605 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:46.829300 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:46.829733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:46.850236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] HTTP exception thrown: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Request method failure captured: Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a HTTP/1.1 Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18do-FP05Ry6MAjUEPFWkvh4Uzu43hSRTwj1uoPeypXtSedRJ08AuH65StzvpmhRECko9oX9DgQr8TINCYeLgAxJW31ZGTrYtwtw8Jms18Zga0cPu8cHkvFt0ww9HQvTeDBNBOfL7eZemFV5U6oB_0XybWO024BN5STIN7WdI3CH5YE Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:19:46.852089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/6476016c570542d3b00f9ed1507655da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_6476016c570542d3b00f9ed1507655da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/6476016c570542d3b00f9ed1507655da"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 6476016c570542d3b00f9ed1507655da Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1774547402 Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 0a3ed8bea97e49628311cb45d48ca699 Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-AttachVolumeTestJSON-1774547402-project Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.853474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'e25fa365-3e8d-4bf5-8914-9ed484c6754a'} Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:46.854231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. Jul 20 09:19:46.855485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:19:46.856622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] Returning 404 to user: Instance e25fa365-3e8d-4bf5-8914-9ed484c6754a could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:46.856622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-48521c25-903f-48b8-9943-e49f02c12f78 tempest-AttachVolumeTestJSON-1774547402 tempest-AttachVolumeTestJSON-1774547402-project] 10.222.0.44 "GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a" status: 404 len: 111 microversion: 2.1 time: 0.037065 Jul 20 09:19:46.858822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 412/813] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:46 2022] GET /compute/v2.1/servers/e25fa365-3e8d-4bf5-8914-9ed484c6754a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:49.474353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-488725891", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1964681893", "security_groups": [{"name": "tempest-secgroup-smoke-1145747553"}], "networks": [{"uuid": "69d2ccdf-7d76-413c-8091-102860f28061"}], "block_device_mapping_v2": [{"uuid": "89739c36-42c7-4b43-857c-44b0b3359bd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:49.623504 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] validate_networks() for [('69d2ccdf-7d76-413c-8091-102860f28061', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:19:50.278752 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:19:50.279510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:19:50.280209 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:19:50.281511 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:19:50.282292 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:19:50.298795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:50.299462 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:50.302099 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:50.302801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:50.326548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Getting quotas for project e6a9958d940546b99e37b85acc95ad7c. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:19:50.331696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Getting quotas for user bcc742eb9e7b42d9bb41f04bb58038db and project e6a9958d940546b99e37b85acc95ad7c. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:19:50.429837 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:19:50.432880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89739c36-42c7-4b43-857c-44b0b3359bd6',volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:19:50.618173 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b5cec7c7-a15b-4ca8-a16f-6bbc354331bb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.147568 Jul 20 09:19:50.621262 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 402/814] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:19:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:19:50.629053 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-fe79be82-b198-4695-9ebf-6b9cd57227f6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:50.629689 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-fe79be82-b198-4695-9ebf-6b9cd57227f6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:50.721133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-fe79be82-b198-4695-9ebf-6b9cd57227f6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:50.727848 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-fe79be82-b198-4695-9ebf-6b9cd57227f6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1088 microversion: 2.1 time: 0.102923 Jul 20 09:19:50.728390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 413/815] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:50 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1088 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:51.752647 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:51.753421 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:51.768113 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:51.769058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:51.770834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:51.775180 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:51.827193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:51.893331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:51.903473 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-70116f39-24b8-4935-948b-af101a0217e8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1194 microversion: 2.1 time: 0.161066 Jul 20 09:19:51.904158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 403/816] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:51 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:52.328313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b25374a4-9150-4e86-9116-5ddd4a7548fd tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Action: 'create', calling method: .version_select at 0x7fadafa03c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-268584400"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:52.799216 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b25374a4-9150-4e86-9116-5ddd4a7548fd tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.617995 Jul 20 09:19:52.799998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 414/817] 10.222.0.44 () {60 vars in 1154 bytes} [Wed Jul 20 09:19:52 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 620 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 20 09:19:52.813017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2fcd567f-ba69-4513-aca3-bf363f9e6527 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc209dc0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:52.903117 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2fcd567f-ba69-4513-aca3-bf363f9e6527 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 200 len: 344 microversion: 2.1 time: 0.095400 Jul 20 09:19:52.903693 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 404/818] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:19:52 2022] GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:52.922462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:52.923273 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:52.932460 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:52.933600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:52.935269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:52.935919 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:53.094385 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:53.102395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4b9f36e0-547e-4d65-8c6f-9cfe4828ea14 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.184881 Jul 20 09:19:53.103015 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 415/819] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:52 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:53.927520 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5017a3e5-a6de-470c-a939-f083bf28041a tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc198c10>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:54.020628 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-3cbc3914-67bc-4f70-bf5e-34bc270e1942 req-11056053-cbb4-488c-8c39-d57465c799ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:54.032919 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5017a3e5-a6de-470c-a939-f083bf28041a tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 200 len: 345 microversion: 2.1 time: 0.119107 Jul 20 09:19:54.034096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 405/820] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:19:53 2022] GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:54.054413 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-be06bc2b-068f-416c-81cf-ed19261cde9a tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Action: 'create', calling method: .version_select at 0x7fadbc198e50>, body: {"snapshot": {"volume_id": "1407a5ab-303a-4964-9e92-21220d4387c8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1960326103"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:19:54.074702 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-3cbc3914-67bc-4f70-bf5e-34bc270e1942 req-11056053-cbb4-488c-8c39-d57465c799ed service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:54.075681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-3cbc3914-67bc-4f70-bf5e-34bc270e1942 req-11056053-cbb4-488c-8c39-d57465c799ed service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:54.095326 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-3cbc3914-67bc-4f70-bf5e-34bc270e1942 req-11056053-cbb4-488c-8c39-d57465c799ed service nova] Creating event network-changed:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:19:54.106102 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-3cbc3914-67bc-4f70-bf5e-34bc270e1942 req-11056053-cbb4-488c-8c39-d57465c799ed service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092351 Jul 20 09:19:54.111524 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 416/821] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:19:54.133802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:54.147786 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:54.170080 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:54.173489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:54.175349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:54.179145 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:54.310670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-be06bc2b-068f-416c-81cf-ed19261cde9a tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.265795 Jul 20 09:19:54.311537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 406/822] 10.222.0.44 () {60 vars in 1161 bytes} [Wed Jul 20 09:19:54 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:54.322019 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9929345d-3913-42c7-921b-29fd69fb4225 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc278790>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:54.377677 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9929345d-3913-42c7-921b-29fd69fb4225 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 200 len: 287 microversion: 2.1 time: 0.059144 Jul 20 09:19:54.378539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 407/823] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:54 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:54.394367 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b541e1b4-a5fc-4c19-aa39-2cb19ad9cbf2 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc24adc0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:54.425320 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:54.432071 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b541e1b4-a5fc-4c19-aa39-2cb19ad9cbf2 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.044960 Jul 20 09:19:54.432875 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 408/824] 10.222.0.44 () {58 vars in 1139 bytes} [Wed Jul 20 09:19:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:54.433815 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c4b89aa6-b15e-49a5-b60f-77fb1b12f00e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.313845 Jul 20 09:19:54.439271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 417/825] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:54 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:54.451439 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-768269f3-732c-4e6d-8ad0-143abad8707e tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc1988b0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:54.504018 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-768269f3-732c-4e6d-8ad0-143abad8707e tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 200 len: 287 microversion: 2.1 time: 0.056716 Jul 20 09:19:54.505136 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 409/826] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:54 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 287 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:55.451090 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:55.451717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:55.459141 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:55.459594 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:55.460380 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:55.460821 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:55.516255 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8aa56bc3-7439-4475-b456-bb78b8022d8d tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc2aae50>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:55.560941 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8aa56bc3-7439-4475-b456-bb78b8022d8d tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 200 len: 287 microversion: 2.1 time: 0.049788 Jul 20 09:19:55.561660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 410/827] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:55 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 287 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:19:55.600791 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:55.610644 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1d53e416-9931-4d22-bbc2-f2f4abc8fd23 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.163534 Jul 20 09:19:55.611239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 418/828] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:55 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:56.573736 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6ea4c305-6116-4596-bc97-389fbd635464 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc23d430>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:56.602373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6ea4c305-6116-4596-bc97-389fbd635464 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 200 len: 287 microversion: 2.1 time: 0.032923 Jul 20 09:19:56.602971 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 411/829] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:56 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:56.628630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:56.629239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:56.635689 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:56.636134 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:56.636893 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:56.637323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:56.772153 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:56.779539 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a6987212-0a40-4a91-8cf6-7348ccadb326 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.155495 Jul 20 09:19:56.780133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 419/830] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:56 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:57.613733 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2c232f3c-21dc-497b-bf4c-dc285ac1c8d0 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc24adc0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:57.799260 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2c232f3c-21dc-497b-bf4c-dc285ac1c8d0 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 200 len: 288 microversion: 2.1 time: 0.189726 Jul 20 09:19:57.799418 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:57.799909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:57.800178 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 412/831] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:57 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 288 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:57.809013 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:57.809452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:57.809827 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-034070b1-2c59-4579-8320-7147abb967b3 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc23d5e0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:57.810197 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:57.810632 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:57.889730 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-034070b1-2c59-4579-8320-7147abb967b3 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 202 len: 0 microversion: 2.1 time: 0.083741 Jul 20 09:19:57.890868 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 413/832] 10.222.0.44 () {58 vars in 1253 bytes} [Wed Jul 20 09:19:57 2022] DELETE /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:19:57.900078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cf178039-b5e6-4c48-9dbf-1f086df7b6d6 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc24aee0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:57.939182 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cf178039-b5e6-4c48-9dbf-1f086df7b6d6 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 200 len: 287 microversion: 2.1 time: 0.043693 Jul 20 09:19:57.940238 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 414/833] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:57 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:19:57.986864 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:57.996398 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-45fffcb0-fd72-4404-98f4-9c1174ee8ba7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.201641 Jul 20 09:19:58.008323 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 420/834] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:57 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:19:58.953932 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-586697e4-04b2-4c60-b6f9-2ace064d3894 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc212f70>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:58.979974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-586697e4-04b2-4c60-b6f9-2ace064d3894 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] HTTP exception thrown: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-586697e4-04b2-4c60-b6f9-2ace064d3894 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Request method failure captured: Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 HTTP/1.1 Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18i4iNEg2wzh8o_AZb0TPtBhKuEUf_0Orkbh0xYA3Gj2uQt82H_hPbYVptPm6Ta8ER-qlbTM-PU3h9IHmGcC1FrZCbx53-qp8qLb97_gA0HzxIykmkYE338OZ0fPFBLaCcVllFkYJMdYnJOYPh1_ksob7sdAiUCHc4194DhpzJe-_Fg Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:19:58.982213 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_01915c889ff44ae2868559d18f5a3714"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 69389036be654235b7aa84c750d880cd Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '656fb0f2-c948-41c8-92df-d5c72f6ac3c7'} Jul 20 09:19:58.984547 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. (HTTP 404) (Request-ID: req-bff17ed8-fd6a-4aae-a5bb-ac10ecb7a4dd) Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.985634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:19:58.987809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 20 09:19:58.989312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-586697e4-04b2-4c60-b6f9-2ace064d3894 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Returning 404 to user: Snapshot 656fb0f2-c948-41c8-92df-d5c72f6ac3c7 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-586697e4-04b2-4c60-b6f9-2ace064d3894 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7" status: 404 len: 111 microversion: 2.1 time: 0.034828 Jul 20 09:19:58.990975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 415/835] 10.222.0.44 () {58 vars in 1250 bytes} [Wed Jul 20 09:19:58 2022] GET /compute/v2.1/os-snapshots/656fb0f2-c948-41c8-92df-d5c72f6ac3c7 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:19:58.994846 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e6a65064-c086-48ec-ad72-a93ce96ac87f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadafa8d9d0>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:59.016384 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:59.017001 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:19:59.018904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:19:59.025244 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:59.025841 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:59.026764 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:19:59.027206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:19:59.064140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e6a65064-c086-48ec-ad72-a93ce96ac87f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 202 len: 0 microversion: 2.1 time: 0.073500 Jul 20 09:19:59.065342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 421/836] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:19:58 2022] DELETE /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:19:59.074672 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-51f96964-0a90-44fd-9df8-d4d29fe960b5 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadaffef790>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:19:59.130617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-51f96964-0a90-44fd-9df8-d4d29fe960b5 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 200 len: 344 microversion: 2.1 time: 0.060228 Jul 20 09:19:59.131376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 422/837] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:19:59 2022] GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:19:59.262246 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:19:59.270787 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-55f34f47-da8b-4e52-aea5-c34cf80d7f5e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.259049 Jul 20 09:19:59.271353 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 416/838] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:19:59 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:20:00.145245 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c1a5b005-264a-4ff2-a3a8-42f8d6903291 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadafa6d820>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:00.193948 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c1a5b005-264a-4ff2-a3a8-42f8d6903291 tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 200 len: 344 microversion: 2.1 time: 0.053103 Jul 20 09:20:00.194529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 423/839] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:20:00 2022] GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:00.287248 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:00.287862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:00.294223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:00.294670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:00.295469 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:00.295904 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:00.315159 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:00.343701 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:00.432523 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:00.441696 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0b5ae402-d842-4c2b-a6fe-b481f6e42161 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.158221 Jul 20 09:20:00.442433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 417/840] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:00 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:01.207981 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5b07b579-30ab-45d3-ac64-13c3aedfaaee tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadaffef790>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:01.214624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:01.299508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-5b07b579-30ab-45d3-ac64-13c3aedfaaee tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] HTTP exception thrown: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5b07b579-30ab-45d3-ac64-13c3aedfaaee tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Request method failure captured: Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 HTTP/1.1 Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18i4iNEg2wzh8o_AZb0TPtBhKuEUf_0Orkbh0xYA3Gj2uQt82H_hPbYVptPm6Ta8ER-qlbTM-PU3h9IHmGcC1FrZCbx53-qp8qLb97_gA0HzxIykmkYE338OZ0fPFBLaCcVllFkYJMdYnJOYPh1_ksob7sdAiUCHc4194DhpzJe-_Fg Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:20:01.303022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_01915c889ff44ae2868559d18f5a3714"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 69389036be654235b7aa84c750d880cd Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '1407a5ab-303a-4964-9e92-21220d4387c8'} Jul 20 09:20:01.304365 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. (HTTP 404) (Request-ID: req-2148948e-1f02-422b-a0ca-489f08f9269d) Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.305395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:20:01.306575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:20:01.310020 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5b07b579-30ab-45d3-ac64-13c3aedfaaee tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Returning 404 to user: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5b07b579-30ab-45d3-ac64-13c3aedfaaee tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 404 len: 109 microversion: 2.1 time: 0.100581 Jul 20 09:20:01.313523 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 424/841] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:20:01 2022] GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 109 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:20:01.319524 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-582137ea-de80-4008-98f5-9f5a18e4535f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadbc2788b0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:01.366232 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-582137ea-de80-4008-98f5-9f5a18e4535f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] HTTP exception thrown: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-582137ea-de80-4008-98f5-9f5a18e4535f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Request method failure captured: Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 HTTP/1.1 Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18i4iNEg2wzh8o_AZb0TPtBhKuEUf_0Orkbh0xYA3Gj2uQt82H_hPbYVptPm6Ta8ER-qlbTM-PU3h9IHmGcC1FrZCbx53-qp8qLb97_gA0HzxIykmkYE338OZ0fPFBLaCcVllFkYJMdYnJOYPh1_ksob7sdAiUCHc4194DhpzJe-_Fg Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:20:01.368606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_01915c889ff44ae2868559d18f5a3714"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 69389036be654235b7aa84c750d880cd Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '1407a5ab-303a-4964-9e92-21220d4387c8'} Jul 20 09:20:01.370196 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. (HTTP 404) (Request-ID: req-f3b94003-7462-4a67-8d16-03174222f67b) Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.371201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 20 09:20:01.372538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 20 09:20:01.373946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.375972 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.377004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-582137ea-de80-4008-98f5-9f5a18e4535f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Returning 404 to user: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:20:01.378500 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-582137ea-de80-4008-98f5-9f5a18e4535f tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 404 len: 109 microversion: 2.1 time: 0.062710 Jul 20 09:20:01.382419 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 418/842] 10.222.0.44 () {58 vars in 1247 bytes} [Wed Jul 20 09:20:01 2022] DELETE /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:20:01.389283 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6517c7d0-e05c-408c-adef-4d2acffa32cf tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Calling method '.version_select at 0x7fadaf9d2040>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:01.422368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-6517c7d0-e05c-408c-adef-4d2acffa32cf tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] HTTP exception thrown: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6517c7d0-e05c-408c-adef-4d2acffa32cf tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Request method failure captured: Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 HTTP/1.1 Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18i4iNEg2wzh8o_AZb0TPtBhKuEUf_0Orkbh0xYA3Gj2uQt82H_hPbYVptPm6Ta8ER-qlbTM-PU3h9IHmGcC1FrZCbx53-qp8qLb97_gA0HzxIykmkYE338OZ0fPFBLaCcVllFkYJMdYnJOYPh1_ksob7sdAiUCHc4194DhpzJe-_Fg Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:20:01.424446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_01915c889ff44ae2868559d18f5a3714"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/01915c889ff44ae2868559d18f5a3714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: 01915c889ff44ae2868559d18f5a3714 Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-61902702 Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: 69389036be654235b7aa84c750d880cd Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-VolumesSnapshotsTestJSON-61902702-project Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': '1407a5ab-303a-4964-9e92-21220d4387c8'} Jul 20 09:20:01.426081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. (HTTP 404) (Request-ID: req-4d42426c-583a-441d-910c-a10ae74f983b) Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.427110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 20 09:20:01.428508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 20 09:20:01.429669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6517c7d0-e05c-408c-adef-4d2acffa32cf tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] Returning 404 to user: Volume 1407a5ab-303a-4964-9e92-21220d4387c8 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6517c7d0-e05c-408c-adef-4d2acffa32cf tempest-VolumesSnapshotsTestJSON-61902702 tempest-VolumesSnapshotsTestJSON-61902702-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8" status: 404 len: 109 microversion: 2.1 time: 0.042117 Jul 20 09:20:01.431014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 425/843] 10.222.0.44 () {58 vars in 1244 bytes} [Wed Jul 20 09:20:01 2022] GET /compute/v2.1/os-volumes/1407a5ab-303a-4964-9e92-21220d4387c8 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:20:01.461579 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:01.462192 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:01.469888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:01.470581 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:01.471618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:01.472083 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:01.649877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:01.658607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-69abb71b-be60-4c28-b4bd-96d952c63913 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.201149 Jul 20 09:20:01.669809 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 419/844] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:01 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:02.677999 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:02.678794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:02.685684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:02.686214 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:02.687901 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:02.688435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:02.842986 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:02.850599 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-87bccdb4-9b2f-49af-99ff-66f42b22cc2f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.178014 Jul 20 09:20:02.851222 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 426/845] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:02 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:03.866725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:03.867349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:03.874171 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:03.874729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:03.875702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:03.876146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:04.031692 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:04.040386 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-85305d7c-caf3-48f6-8769-4829d1f4c837 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.177499 Jul 20 09:20:04.040952 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 420/846] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:03 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:05.057931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:05.058561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:05.069017 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:05.069959 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:05.071284 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:05.071806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:05.243453 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:05.260376 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ce8841da-91ab-4189-9a99-6c0bd5450efb tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.206254 Jul 20 09:20:05.261215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 427/847] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:05 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:06.277242 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:06.277854 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:06.284768 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:06.285221 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:06.286001 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:06.286539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:06.445231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:06.462006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-12b5a0a6-021c-4141-b202-16aac80b38f5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.180650 Jul 20 09:20:06.462006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 421/848] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:06 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:07.472991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:07.473634 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:07.476111 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:07.481600 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:07.482079 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:07.482897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:07.483349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:07.616822 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:07.625072 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c968abbf-a73b-4ce7-99f8-5d4a83f6fdd4 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.157358 Jul 20 09:20:07.625877 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 428/849] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:07 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:08.644066 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:08.644684 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:08.651258 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:08.651714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:08.652528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:08.653040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:08.802078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:08.809815 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-2fe5b1c7-192d-44b6-be12-6cbf6d6b4244 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.170306 Jul 20 09:20:08.810389 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 422/850] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:08 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:20:08.884259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-34cc6ff0-1a3f-481b-ab6f-d8694e67c8e5 req-633a295b-845f-4dc3-a263-12071b89252a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "name": "network-vif-plugged", "status": "completed", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:08.892718 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-34cc6ff0-1a3f-481b-ab6f-d8694e67c8e5 req-633a295b-845f-4dc3-a263-12071b89252a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:08.893170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-34cc6ff0-1a3f-481b-ab6f-d8694e67c8e5 req-633a295b-845f-4dc3-a263-12071b89252a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:08.904794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-34cc6ff0-1a3f-481b-ab6f-d8694e67c8e5 req-633a295b-845f-4dc3-a263-12071b89252a service nova] Creating event network-vif-plugged:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:20:08.910330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-34cc6ff0-1a3f-481b-ab6f-d8694e67c8e5 req-633a295b-845f-4dc3-a263-12071b89252a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029800 Jul 20 09:20:08.910909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 429/851] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:09.828095 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:09.828732 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:09.835119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:09.835567 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:09.836338 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:09.836785 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:09.968483 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:09.976053 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-88e582fb-29bd-4226-9b57-0f9b7581300c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.152711 Jul 20 09:20:09.976543 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 423/852] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:09 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:10.994825 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:10.995535 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:11.002961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:11.003410 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:11.004209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:11.004650 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:11.146472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:11.155137 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4a152351-53fb-4f96-9af7-aea55819ab6f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1260 microversion: 2.1 time: 0.165171 Jul 20 09:20:11.155977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 430/853] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:10 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:12.176911 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:12.177526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:12.184148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:12.184604 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:12.185388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:12.185823 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:12.319241 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:12.327534 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5e61ae3c-22d2-4904-b352-b22a33e122a7 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1444 microversion: 2.1 time: 0.153994 Jul 20 09:20:12.328282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 424/854] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:12 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:12.344621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:12.345225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:12.351840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:12.352291 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:12.353068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:12.353513 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:12.357571 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=74 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:12.486960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:12.494373 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-65b2629a-b921-43b7-8b3f-69ba36b4bfea tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1444 microversion: 2.1 time: 0.154341 Jul 20 09:20:12.494978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 431/855] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:12 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:14.294590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-ef2ebe70-7311-4b17-ac9b-77ae12179119 req-b7e682be-4d1c-44bb-811a-2980704d29f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:14.303718 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-ef2ebe70-7311-4b17-ac9b-77ae12179119 req-b7e682be-4d1c-44bb-811a-2980704d29f2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:14.304215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-ef2ebe70-7311-4b17-ac9b-77ae12179119 req-b7e682be-4d1c-44bb-811a-2980704d29f2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:14.315215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-ef2ebe70-7311-4b17-ac9b-77ae12179119 req-b7e682be-4d1c-44bb-811a-2980704d29f2 service nova] Creating event network-changed:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:20:14.320281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-ef2ebe70-7311-4b17-ac9b-77ae12179119 req-b7e682be-4d1c-44bb-811a-2980704d29f2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029301 Jul 20 09:20:14.320865 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 425/856] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:29.917016 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1235095275", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "networks": [{"uuid": "6e1c742c-4cd4-4fbf-93dd-21fb46610148"}]}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:29.924611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=7 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:29.925279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=5 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:29.971544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] validate_networks() for [('6e1c742c-4cd4-4fbf-93dd-21fb46610148', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:20:30.446815 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:20:30.447239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:20:30.447709 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:20:30.448116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:20:30.448527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:20:30.458987 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:30.459433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:30.460230 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:30.460659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:30.479405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Getting quotas for project 89985f3bd3184d10a94b167827b39a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:20:30.484565 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Getting quotas for user c6cd8828e7b140569aaea330051b00d6 and project 89985f3bd3184d10a94b167827b39a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:20:30.496140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:20:30.498406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:20:30.548031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6115168e-0ac6-49c1-847c-3b10f73f539c tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.635352 Jul 20 09:20:30.548936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 432/857] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:20:30.563789 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-deeea211-861b-452f-9e23-524eaded92a5 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:30.577324 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-deeea211-861b-452f-9e23-524eaded92a5 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:30.584518 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=17 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:30.585460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=52 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:30.645078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-deeea211-861b-452f-9e23-524eaded92a5 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:30.652545 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-deeea211-861b-452f-9e23-524eaded92a5 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1214 microversion: 2.1 time: 0.093878 Jul 20 09:20:30.653337 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 426/858] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:30 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:31.673406 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:31.674136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:31.683422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:31.684117 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:31.685103 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:31.686504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:31.778951 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:31.787367 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-2f2b5391-2570-41b7-b696-715c256f156d tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1272 microversion: 2.1 time: 0.120453 Jul 20 09:20:31.788143 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 433/859] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:31 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1272 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:32.805338 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:32.806060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:32.813867 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:32.814652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:32.815652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:32.816341 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:32.965534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-3cd26bad-121d-4bc3-b820-cc470d32ce5d req-cac113c1-3dca-460b-8fbe-0a7368d08d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57aebe03-5901-4bba-87ab-d29521f117ed", "tag": "1a6309cd-c4fb-4d03-a582-680002b2d389"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:32.970551 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:32.981058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-72cd5256-78cd-4fd0-a06f-09b7edbc597b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1314 microversion: 2.1 time: 0.179690 Jul 20 09:20:32.983397 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 427/860] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:32 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:32.998425 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-3cd26bad-121d-4bc3-b820-cc470d32ce5d req-cac113c1-3dca-460b-8fbe-0a7368d08d37 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:32.998843 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-3cd26bad-121d-4bc3-b820-cc470d32ce5d req-cac113c1-3dca-460b-8fbe-0a7368d08d37 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:33.010208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-3cd26bad-121d-4bc3-b820-cc470d32ce5d req-cac113c1-3dca-460b-8fbe-0a7368d08d37 service nova] Creating event network-changed:1a6309cd-c4fb-4d03-a582-680002b2d389 for instance 57aebe03-5901-4bba-87ab-d29521f117ed on hv-cinder-84330 Jul 20 09:20:33.018597 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-3cd26bad-121d-4bc3-b820-cc470d32ce5d req-cac113c1-3dca-460b-8fbe-0a7368d08d37 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056628 Jul 20 09:20:33.019435 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 434/861] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:34.000460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:34.001237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:34.008200 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:34.008661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:34.009441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:34.009881 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:34.184793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:34.192332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-54c04826-9fdd-45cb-bd4e-386436fcf8ce tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1314 microversion: 2.1 time: 0.196733 Jul 20 09:20:34.192902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 428/862] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:33 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:35.212133 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:35.213009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:35.221993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:35.222451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:35.223266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:35.223717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:35.408650 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:35.419836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e9a2e1a6-3b3c-4cea-b26f-b08b2490e55f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1314 microversion: 2.1 time: 0.213280 Jul 20 09:20:35.421751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 435/863] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:35 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:36.437674 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:36.439051 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:36.445440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:36.445899 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:36.446701 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:36.447168 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:36.609966 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:36.617593 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-62bbf547-d713-4281-b5cf-f8b37ae85d79 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1314 microversion: 2.1 time: 0.184186 Jul 20 09:20:36.618199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 429/864] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:36 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:37.634297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:37.635043 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:37.642316 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:37.642890 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:37.643749 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:37.644271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:37.924834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:37.932189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d334206e-94b6-4dd0-86cb-43b64f64645e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1314 microversion: 2.1 time: 0.301776 Jul 20 09:20:37.932753 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 436/865] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:37 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:38.194404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-a88b356f-436f-4f33-9f88-3bf7918c1e41 req-2bd243aa-0ac1-4656-a163-f3adaceeb705 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57aebe03-5901-4bba-87ab-d29521f117ed", "name": "network-vif-plugged", "status": "completed", "tag": "1a6309cd-c4fb-4d03-a582-680002b2d389"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:38.204434 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a88b356f-436f-4f33-9f88-3bf7918c1e41 req-2bd243aa-0ac1-4656-a163-f3adaceeb705 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:38.204880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a88b356f-436f-4f33-9f88-3bf7918c1e41 req-2bd243aa-0ac1-4656-a163-f3adaceeb705 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:38.216398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-a88b356f-436f-4f33-9f88-3bf7918c1e41 req-2bd243aa-0ac1-4656-a163-f3adaceeb705 service nova] Creating event network-vif-plugged:1a6309cd-c4fb-4d03-a582-680002b2d389 for instance 57aebe03-5901-4bba-87ab-d29521f117ed on hv-cinder-84330 Jul 20 09:20:38.221610 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-a88b356f-436f-4f33-9f88-3bf7918c1e41 req-2bd243aa-0ac1-4656-a163-f3adaceeb705 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030736 Jul 20 09:20:38.222407 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 430/866] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:38.950031 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:38.950969 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:38.958298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:38.958780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:38.959795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:38.960395 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:39.229591 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:39.237868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-daa689ca-a4fc-4e76-9f97-1ece878e52b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1314 microversion: 2.1 time: 0.292227 Jul 20 09:20:39.238755 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 437/867] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:38 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:40.256233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:40.257739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:40.265186 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:40.265642 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:40.266460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:40.266931 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:40.505597 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:40.514653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e6288227-69e5-4bb6-b54a-2b344d56134f tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1498 microversion: 2.1 time: 0.262429 Jul 20 09:20:40.515400 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 431/868] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:40 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1498 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:40.964472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:40.965747 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:40.968820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:40.969779 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:40.975673 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:40.976483 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:40.977812 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:40.978382 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:41.012109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:20:41.102717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-64ab9daa-7e7b-4fe7-b987-c3be9782cede tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 204 len: 0 microversion: 2.1 time: 0.140403 Jul 20 09:20:41.102717 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 438/869] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:20:40 2022] DELETE /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:20:41.117354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:41.118200 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:41.125490 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:41.127862 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:41.128489 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:41.129464 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:41.130306 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:41.347725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:41.355512 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5ba1720e-71ce-4781-b915-a2834c59e197 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1504 microversion: 2.1 time: 0.246276 Jul 20 09:20:41.356249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 432/870] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:41 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:42.374279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:42.375657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:42.383421 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:42.384112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:42.385071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:42.385888 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:42.635107 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:42.645511 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e01f10c9-b05a-4fa5-91a1-83065b1c8559 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1504 microversion: 2.1 time: 0.276152 Jul 20 09:20:42.646900 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 439/871] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:42 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1504 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:43.182914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-7ec616c2-533a-4c0f-b141-b0286f92fafd req-2ce27b10-20cc-4d1f-ab12-5d765eefd03d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57aebe03-5901-4bba-87ab-d29521f117ed", "name": "network-vif-deleted", "tag": "1a6309cd-c4fb-4d03-a582-680002b2d389"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:43.193654 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7ec616c2-533a-4c0f-b141-b0286f92fafd req-2ce27b10-20cc-4d1f-ab12-5d765eefd03d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:43.194455 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-7ec616c2-533a-4c0f-b141-b0286f92fafd req-2ce27b10-20cc-4d1f-ab12-5d765eefd03d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:43.211429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-7ec616c2-533a-4c0f-b141-b0286f92fafd req-2ce27b10-20cc-4d1f-ab12-5d765eefd03d service nova] Creating event network-vif-deleted:1a6309cd-c4fb-4d03-a582-680002b2d389 for instance 57aebe03-5901-4bba-87ab-d29521f117ed on hv-cinder-84330 Jul 20 09:20:43.217183 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-7ec616c2-533a-4c0f-b141-b0286f92fafd req-2ce27b10-20cc-4d1f-ab12-5d765eefd03d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037834 Jul 20 09:20:43.218389 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 433/872] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:43.663297 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:43.663929 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:43.675353 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:43.675882 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:43.676750 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:43.677330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:43.731516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:43.732121 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:43.733227 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lazy-loading 'fault' on Instance uuid 57aebe03-5901-4bba-87ab-d29521f117ed {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:20:43.778165 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:43.787505 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9ea3541c-3685-4aed-b2a9-b882ed4aaf3e tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 200 len: 1304 microversion: 2.1 time: 0.128345 Jul 20 09:20:43.801281 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 440/873] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:43 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 1304 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:44.807849 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:44.809324 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 57aebe03-5901-4bba-87ab-d29521f117ed] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:44.816141 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:44.816803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:44.817984 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:44.818584 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:44.834953 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] HTTP exception thrown: Instance 57aebe03-5901-4bba-87ab-d29521f117ed could not be found. Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Request method failure captured: Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed HTTP/1.1 Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18jcNemSSDW_vcSkkadChf87FwgziZ-7Glos7djdC0XuwJmtMB0_x0Ev1xCxuOEBRAiyBbunUYK3j3aYQ97ODG2ZQH4_dCApxu-38p5W2yO2pKJNTsjOz1xqqGAuFbrpZqndWAYPlCsyqC8oFRSWiQYxAuSxPapoWSrock8fRbYtiSM Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 89985f3bd3184d10a94b167827b39a3f Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesActionsTest-218073984 Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:20:44.836882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesActionsTest-218073984 Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 89985f3bd3184d10a94b167827b39a3f Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesActionsTest-218073984 Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesActionsTest-218073984-project Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: c6cd8828e7b140569aaea330051b00d6 Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesActionsTest-218073984-project Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 57aebe03-5901-4bba-87ab-d29521f117ed could not be found. Jul 20 09:20:44.838392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '57aebe03-5901-4bba-87ab-d29521f117ed'} Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57aebe03-5901-4bba-87ab-d29521f117ed could not be found. Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:20:44.839388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57aebe03-5901-4bba-87ab-d29521f117ed could not be found. Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57aebe03-5901-4bba-87ab-d29521f117ed could not be found. Jul 20 09:20:44.840990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:20:44.843522 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Returning 404 to user: Instance 57aebe03-5901-4bba-87ab-d29521f117ed could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:20:44.844429 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-eac92f2b-cbd7-4636-b20f-9cf92be3abea tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed" status: 404 len: 111 microversion: 2.1 time: 0.041464 Jul 20 09:20:44.845326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 434/874] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:44 2022] GET /compute/v2.1/servers/57aebe03-5901-4bba-87ab-d29521f117ed => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:20:45.016271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-461269083", "imageRef": "106efde6-3cec-4fc6-8196-c458feb417a4", "flavorRef": "452", "networks": [{"uuid": "6e1c742c-4cd4-4fbf-93dd-21fb46610148"}]}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:45.077325 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] validate_networks() for [('6e1c742c-4cd4-4fbf-93dd-21fb46610148', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:20:45.488993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:20:45.489896 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:20:45.490769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:20:45.491393 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:20:45.492037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:20:45.502422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:45.503302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:45.504306 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:45.504990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:45.527216 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Getting quotas for project 89985f3bd3184d10a94b167827b39a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:20:45.532390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Getting quotas for user c6cd8828e7b140569aaea330051b00d6 and project 89985f3bd3184d10a94b167827b39a3f. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:20:45.559991 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:20:45.563354 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='106efde6-3cec-4fc6-8196-c458feb417a4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:20:45.631121 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ffdd95c8-9695-4576-b483-53a9a8b53d22 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619534 Jul 20 09:20:45.638029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 441/875] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:20:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:20:45.643567 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-43293c0e-725b-4656-9b17-2c0a3637b557 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:45.656460 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-43293c0e-725b-4656-9b17-2c0a3637b557 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:45.771714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-43293c0e-725b-4656-9b17-2c0a3637b557 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:45.786498 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-43293c0e-725b-4656-9b17-2c0a3637b557 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1213 microversion: 2.1 time: 0.147527 Jul 20 09:20:45.787114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 435/876] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:45 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1213 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:46.813716 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:46.815213 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:46.827062 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:46.827706 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:46.828685 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:46.829298 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:46.907487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:46.918247 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5f1f72d3-a27d-4854-9cb1-203cfba45773 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1265 microversion: 2.1 time: 0.108242 Jul 20 09:20:46.928609 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 442/877] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:46 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:47.936735 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:47.937352 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:47.951620 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:47.952108 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:47.952948 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:47.953389 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:48.096197 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:48.108655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0710e56e-a263-46af-8e59-c7df8a9960b8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1271 microversion: 2.1 time: 0.176061 Jul 20 09:20:48.109241 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 436/878] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:47 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:49.127530 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:49.128157 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:49.135293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:49.135757 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:49.136575 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:49.137006 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:49.280995 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:49.288895 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-35cea255-a846-4a9b-ac38-ee2139fba7b7 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1313 microversion: 2.1 time: 0.165228 Jul 20 09:20:49.289482 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 443/879] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:49 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:49.980324 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-378ee7d8-0e62-4184-b2c1-f4dce6bc9f79 req-826f55f0-5929-40e6-ac86-0f2a496e9a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c290426-391c-44c1-a2d2-9928470a0983", "tag": "19f9b438-93b5-4534-8150-55595676ce52"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:49.990779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-378ee7d8-0e62-4184-b2c1-f4dce6bc9f79 req-826f55f0-5929-40e6-ac86-0f2a496e9a14 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:49.991230 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-378ee7d8-0e62-4184-b2c1-f4dce6bc9f79 req-826f55f0-5929-40e6-ac86-0f2a496e9a14 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:50.018292 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-378ee7d8-0e62-4184-b2c1-f4dce6bc9f79 req-826f55f0-5929-40e6-ac86-0f2a496e9a14 service nova] Creating event network-changed:19f9b438-93b5-4534-8150-55595676ce52 for instance 8c290426-391c-44c1-a2d2-9928470a0983 on hv-cinder-84330 Jul 20 09:20:50.023519 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-378ee7d8-0e62-4184-b2c1-f4dce6bc9f79 req-826f55f0-5929-40e6-ac86-0f2a496e9a14 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047806 Jul 20 09:20:50.024597 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 437/880] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:50.306965 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:50.308322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:50.317466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:50.318260 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:50.319301 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:50.320105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:50.522129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:50.533576 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3029d6d8-687c-4edb-bdc5-d2d60c392794 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1313 microversion: 2.1 time: 0.231831 Jul 20 09:20:50.543561 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 444/881] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:50 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:51.553527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:51.554233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:51.564795 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:51.565256 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:51.566068 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:51.566513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:52.150336 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:52.157974 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-13518ee0-7455-4aad-8282-84bcbc319cf8 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1313 microversion: 2.1 time: 0.609214 Jul 20 09:20:52.167571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 438/882] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:51 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:53.175907 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:53.176470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:53.183672 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:53.184130 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:53.184939 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:53.186096 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:53.373770 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:53.382173 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7efc02c0-26ed-4b35-9856-1e18f5282368 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1313 microversion: 2.1 time: 0.210348 Jul 20 09:20:53.382780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 445/883] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:53 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1313 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:54.274944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-833c12de-8c83-46de-923b-d74294638d02 req-5d27b314-b8d7-4fe7-a604-706520389d7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c290426-391c-44c1-a2d2-9928470a0983", "name": "network-vif-plugged", "status": "completed", "tag": "19f9b438-93b5-4534-8150-55595676ce52"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:54.284869 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-833c12de-8c83-46de-923b-d74294638d02 req-5d27b314-b8d7-4fe7-a604-706520389d7f service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:54.285372 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-833c12de-8c83-46de-923b-d74294638d02 req-5d27b314-b8d7-4fe7-a604-706520389d7f service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:54.300969 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-833c12de-8c83-46de-923b-d74294638d02 req-5d27b314-b8d7-4fe7-a604-706520389d7f service nova] Creating event network-vif-plugged:19f9b438-93b5-4534-8150-55595676ce52 for instance 8c290426-391c-44c1-a2d2-9928470a0983 on hv-cinder-84330 Jul 20 09:20:54.306780 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-833c12de-8c83-46de-923b-d74294638d02 req-5d27b314-b8d7-4fe7-a604-706520389d7f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035415 Jul 20 09:20:54.307765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 439/884] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:54.399215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:54.399923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:54.411708 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:54.415715 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:54.416977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:54.417639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:54.607357 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:54.616936 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e8c03b30-9eca-4415-a2d1-f9f1d05147ab tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1313 microversion: 2.1 time: 0.222071 Jul 20 09:20:54.617735 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 446/885] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:54 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:55.634098 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:55.634984 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:55.645746 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:55.646305 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:55.647195 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:55.647707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:55.776994 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:55.800738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:55.821165 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-cdd95d30-21cd-47e3-bf60-e811a410a9a3 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1313 microversion: 2.1 time: 0.191174 Jul 20 09:20:55.827847 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 440/886] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:55 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:56.844479 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:56.845820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:56.848617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:56.849555 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:56.858578 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:56.859158 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:56.860057 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:56.860557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:57.011189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:57.019070 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-24699edd-80ac-4940-adfe-8dc0100fe413 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1497 microversion: 2.1 time: 0.179000 Jul 20 09:20:57.019875 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 447/887] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:56 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:20:57.478022 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:57.478539 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:57.486059 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:57.486513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:57.487320 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:57.487760 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:57.515580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:20:57.611958 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e1b65ccb-d816-41b7-a986-a1110d84c85b tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 204 len: 0 microversion: 2.1 time: 0.137123 Jul 20 09:20:57.615130 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 441/888] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:20:57 2022] DELETE /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:20:57.623534 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:57.624153 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:57.630212 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:57.630665 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:57.631487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:57.631921 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:57.653518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:20:57.804930 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:57.813350 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1d0c81af-ba7d-482d-a151-fa2c8a8e6a3a tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1503 microversion: 2.1 time: 0.193780 Jul 20 09:20:57.814486 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 448/889] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:57 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:58.831435 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:58.832287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:58.842524 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:58.843039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:58.843836 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:58.844273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:58.989457 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:58.997253 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7c645157-1b36-440c-92b6-b511497c46fb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1503 microversion: 2.1 time: 0.170280 Jul 20 09:20:58.999119 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 442/890] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:58 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1503 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:20:59.175149 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-cffcd4a3-ea26-4639-8027-e68c90963279 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Action: 'create', calling method: .version_select at 0x7fadafaa3430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1476435398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/1PD8NxwdfqKLAyjyzL6I6Xlpo9uQCTtCeIjbXkgATr3yl9iB2jjfymfY0t7ujq9vFeJa+YpFRohmf1sgB2uiLFr257uZQxID7e7J20zu3F1mjTtefiSjCXox1TMlhRQ=="}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:59.189657 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-cffcd4a3-ea26-4639-8027-e68c90963279 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Getting quotas for project 96007c68c7f349a19f6bc8c16f024cc6. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:20:59.193386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-cffcd4a3-ea26-4639-8027-e68c90963279 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Getting quotas for user 5a2f15a789f1482ba7a4ecbd260913ea and project 96007c68c7f349a19f6bc8c16f024cc6. Resources: {'key_pairs'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:20:59.214989 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-cffcd4a3-ea26-4639-8027-e68c90963279 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043650 Jul 20 09:20:59.215579 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 449/891] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:20:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:59.327557 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-257568552", "imageRef": "55e3c427-f8f4-4282-9adf-1235dd65c781", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1476435398", "networks": [{"uuid": "61a20c5c-e8b8-4301-8f2a-febb08b04dd1"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:59.379455 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] validate_networks() for [('61a20c5c-e8b8-4301-8f2a-febb08b04dd1', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:20:59.401829 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-11833138-2033-4470-89e2-4a0082a22c97 req-729c35a0-f587-43dd-8796-976537b3ee32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c290426-391c-44c1-a2d2-9928470a0983", "name": "network-vif-deleted", "tag": "19f9b438-93b5-4534-8150-55595676ce52"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:20:59.413671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-11833138-2033-4470-89e2-4a0082a22c97 req-729c35a0-f587-43dd-8796-976537b3ee32 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:59.414196 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-11833138-2033-4470-89e2-4a0082a22c97 req-729c35a0-f587-43dd-8796-976537b3ee32 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:59.426221 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-11833138-2033-4470-89e2-4a0082a22c97 req-729c35a0-f587-43dd-8796-976537b3ee32 service nova] Creating event network-vif-deleted:19f9b438-93b5-4534-8150-55595676ce52 for instance 8c290426-391c-44c1-a2d2-9928470a0983 on hv-cinder-84330 Jul 20 09:20:59.431368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-11833138-2033-4470-89e2-4a0082a22c97 req-729c35a0-f587-43dd-8796-976537b3ee32 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033374 Jul 20 09:20:59.432320 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 450/892] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:20:59.770399 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:20:59.771017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:20:59.771453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:20:59.771753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:20:59.772158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:20:59.781997 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:59.782444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:59.783287 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:20:59.783729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:20:59.800661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Getting quotas for project 96007c68c7f349a19f6bc8c16f024cc6. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:20:59.804860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Getting quotas for user 5a2f15a789f1482ba7a4ecbd260913ea and project 96007c68c7f349a19f6bc8c16f024cc6. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:20:59.816206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:20:59.818392 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='55e3c427-f8f4-4282-9adf-1235dd65c781',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:20:59.863596 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6d020ec1-e8d3-4eaa-a052-bb2835104237 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540824 Jul 20 09:20:59.864275 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 443/893] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:20:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:20:59.875306 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-fead485e-65c3-44f6-a562-63cd66b0ebd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:20:59.876005 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-fead485e-65c3-44f6-a562-63cd66b0ebd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:20:59.932629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-fead485e-65c3-44f6-a562-63cd66b0ebd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:20:59.942503 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-fead485e-65c3-44f6-a562-63cd66b0ebd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1258 microversion: 2.1 time: 0.071885 Jul 20 09:20:59.943170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 451/894] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:20:59 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:00.016401 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:00.017241 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:00.026232 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:00.026700 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:00.027573 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:00.028022 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:00.061454 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:00.061884 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:00.062312 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lazy-loading 'fault' on Instance uuid 8c290426-391c-44c1-a2d2-9928470a0983 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:21:00.105231 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c6cd8828e7b140569aaea330051b00d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89985f3bd3184d10a94b167827b39a3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:00.113382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-de6fef46-f5e3-4e8a-a32f-0a46acb33641 tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 200 len: 1303 microversion: 2.1 time: 0.101724 Jul 20 09:21:00.114160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 444/895] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:00 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:00.960622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:00.961236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:00.964745 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:00.972179 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:00.972820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:00.973763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:00.974373 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:01.042669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:01.051239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-09962c1a-32c2-47b2-8bf7-0613150e6745 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1316 microversion: 2.1 time: 0.094094 Jul 20 09:21:01.051510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 452/896] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:00 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1316 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:01.132177 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:01.133012 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] [instance: 8c290426-391c-44c1-a2d2-9928470a0983] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:01.135608 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:01.142485 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:01.143205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:01.144468 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:01.145074 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:01.150804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:01.166322 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] HTTP exception thrown: Instance 8c290426-391c-44c1-a2d2-9928470a0983 could not be found. Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Request method failure captured: Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 HTTP/1.1 Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18jcNemSSDW_vcSkkadChf87FwgziZ-7Glos7djdC0XuwJmtMB0_x0Ev1xCxuOEBRAiyBbunUYK3j3aYQ97ODG2ZQH4_dCApxu-38p5W2yO2pKJNTsjOz1xqqGAuFbrpZqndWAYPlCsyqC8oFRSWiQYxAuSxPapoWSrock8fRbYtiSM Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 89985f3bd3184d10a94b167827b39a3f Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-VolumesActionsTest-218073984 Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:21:01.168169 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/89985f3bd3184d10a94b167827b39a3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-VolumesActionsTest-218073984 Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 89985f3bd3184d10a94b167827b39a3f Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-VolumesActionsTest-218073984 Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-VolumesActionsTest-218073984-project Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: c6cd8828e7b140569aaea330051b00d6 Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-VolumesActionsTest-218073984-project Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 8c290426-391c-44c1-a2d2-9928470a0983 could not be found. Jul 20 09:21:01.169706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '8c290426-391c-44c1-a2d2-9928470a0983'} Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c290426-391c-44c1-a2d2-9928470a0983 could not be found. Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:21:01.170528 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c290426-391c-44c1-a2d2-9928470a0983 could not be found. Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c290426-391c-44c1-a2d2-9928470a0983 could not be found. Jul 20 09:21:01.177676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:21:01.178951 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] Returning 404 to user: Instance 8c290426-391c-44c1-a2d2-9928470a0983 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:21:01.178951 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6e80d3e8-1490-4c28-9198-2ec06db73edb tempest-VolumesActionsTest-218073984 tempest-VolumesActionsTest-218073984-project] 10.222.0.44 "GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983" status: 404 len: 111 microversion: 2.1 time: 0.043372 Jul 20 09:21:01.178951 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 445/897] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:01 2022] GET /compute/v2.1/servers/8c290426-391c-44c1-a2d2-9928470a0983 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:21:02.071932 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:02.073846 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:02.086906 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:02.087961 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:02.089466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:02.090400 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:02.314798 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:02.323662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-10518407-7e09-4a7f-8784-b080832e4c4c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.258619 Jul 20 09:21:02.328954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 453/898] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:02 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:03.345330 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:03.345953 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:03.353270 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:03.354375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:03.355224 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:03.355669 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:03.502954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:03.510457 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4fdd28f2-d076-466d-8135-06ddaa97ddb7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.171035 Jul 20 09:21:03.511052 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 446/899] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:03 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:04.532802 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:04.533424 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:04.546259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:04.550617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:04.551742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:04.552760 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:04.695842 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:04.704358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-191bed51-8f43-476f-82e2-92b960f1e49c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.180422 Jul 20 09:21:04.704928 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 454/900] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:04 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:05.721859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:05.723154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:05.729942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:05.730402 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:05.731221 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:05.733028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:05.881668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:05.891254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-021c17cd-9495-4231-af5e-fcc321b6c8e1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.171545 Jul 20 09:21:05.891254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 447/901] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:05 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:06.908688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:06.909979 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:06.917495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:06.918193 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:06.920541 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:06.921163 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:07.090037 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:07.103347 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a5bc4245-4d84-4054-b3b3-42133626625b tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.199516 Jul 20 09:21:07.115237 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 455/902] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:06 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:08.124534 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:08.125221 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:08.134834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:08.135290 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:08.136083 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:08.137496 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:08.364044 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:08.376525 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8f9f9b6c-9a82-48aa-bb04-9a45c1e6aa48 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.257049 Jul 20 09:21:08.377430 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 448/903] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:08 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:21:09.405112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:09.405112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:09.412966 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:09.423379 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:09.424228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:09.424674 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:09.593576 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:09.605381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-42341c16-0418-4f46-8fbe-5d4a56401442 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.215518 Jul 20 09:21:09.615089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 456/904] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:09 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:10.076758 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:10.078150 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:10.090266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-479226c3-0bc9-4772-a958-28ae45b0ab63 req-efe107cd-b20f-4828-b7cb-c946c76d30a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:21:10.125225 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-479226c3-0bc9-4772-a958-28ae45b0ab63 req-efe107cd-b20f-4828-b7cb-c946c76d30a6 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:10.125782 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-479226c3-0bc9-4772-a958-28ae45b0ab63 req-efe107cd-b20f-4828-b7cb-c946c76d30a6 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:10.140555 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-479226c3-0bc9-4772-a958-28ae45b0ab63 req-efe107cd-b20f-4828-b7cb-c946c76d30a6 service nova] Creating event network-changed:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:21:10.146302 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-479226c3-0bc9-4772-a958-28ae45b0ab63 req-efe107cd-b20f-4828-b7cb-c946c76d30a6 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071321 Jul 20 09:21:10.147592 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 449/905] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:21:10.621609 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:10.622629 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:10.624747 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:10.636152 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:10.636885 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:10.638386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:10.639144 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:10.804866 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:10.818536 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f331bf5a-c6f8-47a5-b5df-7256552585ad tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.200774 Jul 20 09:21:10.819154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 457/906] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:10 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:11.837785 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:11.838497 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:11.847176 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:11.847975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:11.849114 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:11.849921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:12.168548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:12.207806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4cd72300-dba8-46d7-bea3-0a06620011b4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.346625 Jul 20 09:21:12.218832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 450/907] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:11 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:13.226084 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:13.227078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:13.236281 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:13.237146 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:13.238502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:13.239391 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:13.387970 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:13.395761 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4d459fe1-b9f0-48a2-ab3c-15660e9ac53f tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.173849 Jul 20 09:21:13.396329 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 458/908] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:13 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:14.380810 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-8579b7a8-0c50-4d10-b062-a99e261688b8 req-cd34d8b3-012e-4c82-8e54-097f2fd981d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "name": "network-vif-plugged", "status": "completed", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:21:14.392253 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8579b7a8-0c50-4d10-b062-a99e261688b8 req-cd34d8b3-012e-4c82-8e54-097f2fd981d4 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:14.393516 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-8579b7a8-0c50-4d10-b062-a99e261688b8 req-cd34d8b3-012e-4c82-8e54-097f2fd981d4 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:14.408173 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-8579b7a8-0c50-4d10-b062-a99e261688b8 req-cd34d8b3-012e-4c82-8e54-097f2fd981d4 service nova] Creating event network-vif-plugged:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:21:14.416370 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:14.417958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:14.432563 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:14.433458 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-8579b7a8-0c50-4d10-b062-a99e261688b8 req-cd34d8b3-012e-4c82-8e54-097f2fd981d4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054566 Jul 20 09:21:14.435298 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 451/909] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:21:14.436837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:14.439097 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:14.440068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:14.648921 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:14.658662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-dc60c745-53b9-4464-aa0c-d0d9eb1733e5 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.246387 Jul 20 09:21:14.660311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 459/910] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:14 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:15.676932 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:15.678418 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:15.687902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:15.688732 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:15.690122 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:15.690625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:15.859233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:15.869999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-67b5f3dc-db33-44a0-bbfd-b219fd4602ee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1358 microversion: 2.1 time: 0.197376 Jul 20 09:21:15.879588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 452/911] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:15 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:16.892271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:16.893163 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:16.901517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:16.901971 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:16.902784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:16.903870 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.073025 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:17.084666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d298c76c-ff70-46be-a432-51ac4ae4e7c1 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1547 microversion: 2.1 time: 0.200023 Jul 20 09:21:17.090740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 460/912] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:16 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1547 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:17.102268 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:17.103493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:17.111453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:17.112146 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.113106 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:17.113706 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.274202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:17.282226 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a050ed6e-684e-48c7-a837-02c929806d93 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1547 microversion: 2.1 time: 0.184250 Jul 20 09:21:17.283011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 453/913] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:17 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1547 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:21:17.299784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:17.303560 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:17.304182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Searching by: {'deleted': False, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6'} {{(pid=117872) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 20 09:21:17.312155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:17.312611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.313415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:17.313852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.410164 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.multi_cell_list [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117872) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 20 09:21:17.536989 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-54cac439-2d72-4428-8912-04ada82f48d6 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.240873 Jul 20 09:21:17.537669 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 461/914] 10.222.0.44 () {58 vars in 1124 bytes} [Wed Jul 20 09:21:17 2022] GET /compute/v2.1/servers => generated 342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 20 09:21:17.550177 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:17.551019 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:17.558180 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:17.558639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.559506 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:17.559947 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:17.708577 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:17.717354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4fec1d1a-70f6-4df4-9ae2-4bb095944bd7 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1547 microversion: 2.1 time: 0.172369 Jul 20 09:21:17.717942 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 454/915] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:17 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1547 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:19.390490 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9572589-03b3-4c1c-ad5f-dba073d6f154"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:21:19.393251 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:19.403670 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:19.404441 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:19.405834 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:19.406487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:19.728942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-855c23eb-a218-4b0f-942c-9fecebfd25e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.344950 Jul 20 09:21:19.729705 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 462/916] 10.222.0.44 () {60 vars in 1322 bytes} [Wed Jul 20 09:21:19 2022] POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:21:26.277459 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:26.278181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:26.284995 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:26.285453 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:26.286229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:26.286671 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:26.419782 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:26.427902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-f07e64e1-bb8d-4487-91ca-01dd2285b95e tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1593 microversion: 2.1 time: 0.154431 Jul 20 09:21:26.428471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 455/917] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:26 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1593 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:28.240278 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:28.467203 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-1e66609e-4403-4033-88eb-438bcdc5f2ac req-1752565f-4bd1-43f4-8d49-c6c4ffd47670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:21:28.480073 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-1e66609e-4403-4033-88eb-438bcdc5f2ac req-1752565f-4bd1-43f4-8d49-c6c4ffd47670 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:28.480894 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-1e66609e-4403-4033-88eb-438bcdc5f2ac req-1752565f-4bd1-43f4-8d49-c6c4ffd47670 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:28.486485 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:21:28.496081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-1e66609e-4403-4033-88eb-438bcdc5f2ac req-1752565f-4bd1-43f4-8d49-c6c4ffd47670 service nova] Creating event network-changed:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:21:28.502226 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-1e66609e-4403-4033-88eb-438bcdc5f2ac req-1752565f-4bd1-43f4-8d49-c6c4ffd47670 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.269994 Jul 20 09:21:28.503264 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 463/918] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:21:29.372434 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2011946705"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:21:29.372975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:29.379765 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:29.380227 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:29.381009 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:29.381450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:29.515104 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.network.security_group_api [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Adding security group c3f6ca76-675e-4fe4-bd03-7eb2b71a62cb to port b7669c6d-76e8-446f-875d-bd0acc55abdb Jul 20 09:21:29.912747 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6868612b-ed57-41c9-90b4-23c27ca6d5fb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.545151 Jul 20 09:21:29.913569 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 456/919] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:21:29 2022] POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/action => generated 0 bytes in 547 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:21:29.926879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:21:29.927721 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:21:29.938301 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:29.938978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:29.939883 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:29.940604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:30.336332 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:21:30.346333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-53ec7352-a7a2-408c-913d-fe4d1be65e8a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1758 microversion: 2.1 time: 0.427254 Jul 20 09:21:30.347429 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 464/920] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:21:29 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1758 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:21:30.520848 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-795f1d1f-a350-4748-9925-4fe7b70ae5d2 req-42c666f7-09fe-43fe-8d37-25d5b2936a2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:21:30.530046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-795f1d1f-a350-4748-9925-4fe7b70ae5d2 req-42c666f7-09fe-43fe-8d37-25d5b2936a2d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:21:30.530572 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-795f1d1f-a350-4748-9925-4fe7b70ae5d2 req-42c666f7-09fe-43fe-8d37-25d5b2936a2d service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:21:30.546456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-795f1d1f-a350-4748-9925-4fe7b70ae5d2 req-42c666f7-09fe-43fe-8d37-25d5b2936a2d service nova] Creating event network-changed:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:21:30.552171 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-795f1d1f-a350-4748-9925-4fe7b70ae5d2 req-42c666f7-09fe-43fe-8d37-25d5b2936a2d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035829 Jul 20 09:21:30.553639 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 457/921] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:02.431649 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:02.432651 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:02.435283 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=25 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.435937 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=7 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.441790 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:02.442237 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:02.443030 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:02.443466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:02.516597 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9f162f2c-aa41-4839-8419-5a6c2de6ccee tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.088675 Jul 20 09:22:02.517352 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 465/922] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:22:02 2022] POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:22:02.523655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=25 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.524407 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=59 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:02.529502 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:02.530221 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:02.537411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:02.537877 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:02.538763 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:02.539215 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:02.686953 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:02.694796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b286886c-6244-4d4c-9d17-c5a982a82b63 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1750 microversion: 2.1 time: 0.172861 Jul 20 09:22:02.695367 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 458/923] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:02 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:03.714415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:03.715173 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:03.721554 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:03.722004 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:03.722796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:03.723228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:03.864454 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:03.873535 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-d004ad01-9ba6-4bc1-b391-d3fc37ac5dd3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.163772 Jul 20 09:22:03.874106 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 466/924] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:03 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:04.891347 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:04.891956 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:04.898485 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:04.898958 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:04.899724 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:04.900158 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:05.040876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:05.048876 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4d95a768-a5eb-44ac-97bf-b713b9050794 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.161982 Jul 20 09:22:05.049440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 459/925] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:04 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:06.065579 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:06.066195 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:06.072852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:06.073304 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:06.074069 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:06.075914 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:06.215618 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:06.223473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b88ea1e3-0bc0-4905-8f22-7288fd42d102 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.161762 Jul 20 09:22:06.224038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 467/926] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:06 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:07.242242 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:07.242813 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:07.250170 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:07.250629 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:07.251432 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:07.251880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:07.394220 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:07.402245 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-bb61af86-8b40-43d0-a25b-d514f03ddedf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.163985 Jul 20 09:22:07.403181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 460/927] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:07 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:08.419494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:08.420167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:08.426612 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:08.427093 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:08.427852 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:08.428286 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:08.569604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:08.578751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3927e5b4-767f-41fe-9fba-8299818a569c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.163127 Jul 20 09:22:08.579333 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 468/928] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:08 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:09.596078 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:09.596695 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:09.602834 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:09.603278 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:09.604034 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:09.604466 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:09.749033 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:09.756960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4c449ff6-35f6-48cc-b9a7-ce88e91035e2 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.164911 Jul 20 09:22:09.757527 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 461/929] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:09 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:10.775249 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:10.775891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:10.782854 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:10.783312 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:10.784082 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:10.784527 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:10.923384 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:10.931339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-dcc78ee3-2d32-43dc-9710-22455f266fa4 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.160149 Jul 20 09:22:10.931909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 469/930] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:10 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:11.949004 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:11.949666 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:11.956925 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:11.957381 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:11.958150 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:11.958594 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:11.978038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:11.978587 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:11.985652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:11.986100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:11.986894 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:11.987327 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:12.010129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lazy-loading 'flavor' on Instance uuid 15d7778e-9051-4436-a321-0a45cc1f8643 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:22:12.085061 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-018584f4-4b37-463a-b4f4-b6ca4fc8af9c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "POST /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643/action" status: 202 len: 0 microversion: 2.1 time: 0.110604 Jul 20 09:22:12.085898 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 470/931] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:22:11 2022] POST /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 20 09:22:12.094811 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:12.095525 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:12.102891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:12.103351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:12.104136 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:12.104581 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:12.119278 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:12.128558 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-04cd231d-e84f-439c-8c40-fb27f63bc709 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.183474 Jul 20 09:22:12.129233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 462/932] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:11 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:12.236956 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:12.244489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-53870416-346a-4474-ab53-6c6a70843d45 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.154512 Jul 20 09:22:12.245055 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 471/933] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:12 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:13.146778 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:13.147398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:13.153982 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:13.154430 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:13.155223 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:13.155660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:13.261318 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:13.262208 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:13.268815 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:13.269351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:13.270203 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:13.270655 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:13.298628 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:13.306870 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7bc9e5e5-37b0-4943-9713-e263f9221100 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1755 microversion: 2.1 time: 0.163916 Jul 20 09:22:13.307441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 463/934] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:13 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:13.405656 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:13.413283 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-42be4bec-bb32-4f70-84d8-1cf39e532c91 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.155887 Jul 20 09:22:13.413850 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 472/935] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:13 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:14.324055 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:14.325465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:14.332390 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:14.332843 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:14.333630 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:14.334073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:14.430533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:14.431242 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:14.438287 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:14.438793 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:14.439572 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:14.440009 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:14.475562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:14.484315 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-79dca59f-46d4-4072-964a-c6eff353e168 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1758 microversion: 2.1 time: 0.164212 Jul 20 09:22:14.484970 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 464/936] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:14 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:14.576696 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:14.584244 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bae197a3-5bbe-4416-b9b3-2372625a8afd tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.157550 Jul 20 09:22:14.584803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 473/937] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:14 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:15.601342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:15.601959 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:15.608631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:15.609085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:15.609853 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:15.610293 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:15.739328 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:15.748046 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fa5d5bc3-399e-467d-bfa4-d3dc4df30ece tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.150530 Jul 20 09:22:15.748626 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 465/938] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:15 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:16.765925 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:16.766547 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:16.773092 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:16.773544 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:16.774313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:16.774785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:16.909220 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:16.916782 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-28308e45-9535-43c1-9016-6f564abc1720 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.155306 Jul 20 09:22:16.917351 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 474/939] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:16 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:17.935403 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:17.936023 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:17.942578 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:17.943067 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:17.943832 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:17.944272 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:18.076875 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:18.084238 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-83845dc3-48ea-4b1a-a3f8-2fd03d04902e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.153776 Jul 20 09:22:18.084806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 466/940] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:17 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:19.101466 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:19.102075 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:19.109448 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:19.109903 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:19.110740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:19.111189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:19.241255 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:19.248776 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1c8f2bc9-99c5-46f7-ac58-7e64e1bd19ca tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.151165 Jul 20 09:22:19.249340 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 475/941] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:19 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:20.265479 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:20.266086 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:20.272725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:20.273187 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:20.273967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:20.274412 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:20.408513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:20.416064 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-88a8041d-ca1a-40ab-84f2-5f7f6906edef tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.154626 Jul 20 09:22:20.416655 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 467/942] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:20 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:21.434754 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:21.435371 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:21.442891 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:21.443364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:21.444132 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:21.444562 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:21.575353 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:21.583056 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b0bd446f-19c5-4048-8d9d-df26515b4ae5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.152928 Jul 20 09:22:21.583621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 476/943] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:21 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:22.600124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:22.600866 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:22.611326 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:22.611785 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:22.614551 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:22.614551 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:22.753131 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:22.761400 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a33e9115-58ba-4c66-9e07-435697c7ba4c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.165140 Jul 20 09:22:22.761988 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 468/944] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:22 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:23.778759 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:23.779409 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:23.786155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:23.786604 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:23.787399 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:23.787831 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:23.919202 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:23.926762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-12241b1e-640e-4e05-9647-8ee8df0d642b tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.152189 Jul 20 09:22:23.927326 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 477/945] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:23 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:24.945891 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:24.947075 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:24.957408 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:24.957864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:24.958650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:24.959129 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:25.093669 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:25.101127 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4031fe68-4b94-4bbc-b7e9-02d1722ff15a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1570 microversion: 2.1 time: 0.160459 Jul 20 09:22:25.101693 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 469/946] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:24 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:25.117614 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:25.118192 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:25.125295 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:25.125739 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:25.126510 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:25.126975 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:25.144321 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:25.205183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-5c5bca9c-46af-4ec3-9508-8afd308513a5 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "POST /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643/action" status: 202 len: 0 microversion: 2.1 time: 0.091518 Jul 20 09:22:25.205807 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 478/947] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:22:25 2022] POST /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:22:25.214017 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:25.214641 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:25.220691 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:25.221154 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:25.221940 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:25.222410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:25.360575 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:25.368144 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-c7d3ceeb-f0eb-4f19-9e13-b23c796482c1 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1518 microversion: 2.1 time: 0.158052 Jul 20 09:22:25.377776 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 470/948] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:25 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1518 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:26.386305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:26.387167 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:26.394209 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:26.394715 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:26.395577 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:26.396014 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:26.534403 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:26.546506 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-36487883-8822-4506-b164-04052a107e98 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1520 microversion: 2.1 time: 0.164534 Jul 20 09:22:26.547383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 479/949] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:26 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:26.684975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-e237794e-cea9-441f-8ab6-967bcfa8a6a3 req-a4fab97c-5be4-4457-a585-c1a2e8459f43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "name": "network-vif-unplugged", "status": "completed", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:26.693568 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-e237794e-cea9-441f-8ab6-967bcfa8a6a3 req-a4fab97c-5be4-4457-a585-c1a2e8459f43 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:26.694028 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-e237794e-cea9-441f-8ab6-967bcfa8a6a3 req-a4fab97c-5be4-4457-a585-c1a2e8459f43 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:26.706470 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-e237794e-cea9-441f-8ab6-967bcfa8a6a3 req-a4fab97c-5be4-4457-a585-c1a2e8459f43 service nova] Creating event network-vif-unplugged:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:22:26.711493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-e237794e-cea9-441f-8ab6-967bcfa8a6a3 req-a4fab97c-5be4-4457-a585-c1a2e8459f43 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030280 Jul 20 09:22:26.712085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 471/950] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:27.563839 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:27.564452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:27.571028 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:27.571472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:27.572229 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:27.572661 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:27.710667 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:27.718853 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-41dfe770-538e-49fc-a4af-aa36ed19237a tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.158865 Jul 20 09:22:27.719687 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 480/951] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:27 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:22:28.737736 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:28.738441 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:28.744751 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:28.745199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:28.746002 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:28.746403 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:28.877644 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:28.885141 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fa58c182-6e22-4858-8558-9ffb2cad4309 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.152102 Jul 20 09:22:28.885707 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 472/952] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:28 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:29.902606 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:29.903313 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:29.909724 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:29.910173 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:29.910972 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:29.911408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:30.040018 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:30.048223 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-b7124cab-7dc2-4db9-b79e-f1f47f3cb0ec tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.149583 Jul 20 09:22:30.048789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 481/953] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:29 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:31.065373 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:31.065993 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:31.072505 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:31.072963 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:31.073726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:31.075398 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:31.207546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:31.215464 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-64a63aee-2032-4fe9-9fed-c3109d419e6c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.153434 Jul 20 09:22:31.216047 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 473/954] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:31 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:32.233124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:32.233686 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:32.240154 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:32.240603 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:32.241355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:32.241788 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:32.370122 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:32.377789 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9f6785cd-90a6-4d9e-9ae2-1d2065f80763 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.149166 Jul 20 09:22:32.378364 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 482/955] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:32 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:33.395133 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:33.395787 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:33.398194 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=33 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.404204 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:33.404666 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:33.405440 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:33.405886 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:33.408476 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=93 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:33.541193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:33.549477 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d639e3cd-8422-47f5-a6ad-a5c7c1361bd6 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.158227 Jul 20 09:22:33.550040 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 474/956] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:33 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:34.566934 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:34.567552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:34.570052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=39 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:34.576522 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:34.576977 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:34.577794 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:34.578269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:34.713399 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:34.721392 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-319ec265-203b-4292-8ca1-777374f6e25f tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.158348 Jul 20 09:22:34.721970 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 483/957] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:34 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:35.738406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:35.739050 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:35.745660 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:35.746107 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:35.746902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:35.747487 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:35.883829 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:35.892015 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-5f8f798c-fd4c-4025-a922-81084085c40e tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.157607 Jul 20 09:22:35.892578 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 475/958] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:35 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:36.777344 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-3e015459-9e74-453d-8200-521f9de88090 req-5211d3e3-81ae-4a4b-b07f-e9abf983222b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "name": "network-vif-plugged", "status": "completed", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:36.786378 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-3e015459-9e74-453d-8200-521f9de88090 req-5211d3e3-81ae-4a4b-b07f-e9abf983222b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:36.786853 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-3e015459-9e74-453d-8200-521f9de88090 req-5211d3e3-81ae-4a4b-b07f-e9abf983222b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:36.798817 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-3e015459-9e74-453d-8200-521f9de88090 req-5211d3e3-81ae-4a4b-b07f-e9abf983222b service nova] Creating event network-vif-plugged:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:22:36.803777 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-3e015459-9e74-453d-8200-521f9de88090 req-5211d3e3-81ae-4a4b-b07f-e9abf983222b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030101 Jul 20 09:22:36.804374 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 484/959] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:36.909339 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:36.909977 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:36.916411 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:36.916865 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:36.917642 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:36.918085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:37.061324 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:37.068950 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d570b4e4-eb4e-41f5-89a1-977edb8a3990 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1576 microversion: 2.1 time: 0.163660 Jul 20 09:22:37.069526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 476/960] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:36 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:38.086905 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:38.087611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:38.094293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:38.094771 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:38.095540 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:38.095978 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:38.227217 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:38.235187 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7d4e76c5-cc6e-4626-aa70-e74de06a0cc8 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1563 microversion: 2.1 time: 0.152924 Jul 20 09:22:38.235770 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 485/961] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:38 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:47.483088 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2011946705"}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:47.483702 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:47.485777 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=5 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.486546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=17 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:22:47.492317 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:47.492764 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:47.493524 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:47.493960 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:47.677139 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.network.security_group_api [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Removing security group c3f6ca76-675e-4fe4-bd03-7eb2b71a62cb from port b7669c6d-76e8-446f-875d-bd0acc55abdb Jul 20 09:22:48.012808 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-70b6bf29-04a6-483d-8d98-812ed8af8863 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/action" status: 202 len: 0 microversion: 2.1 time: 0.534247 Jul 20 09:22:48.022092 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 477/962] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Jul 20 09:22:47 2022] POST /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/action => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:22:48.022294 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-18a63f16-4611-46e2-b631-e09862a6b081 req-f3e13af7-e119-4cc9-a3b9-eb7793f64628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:48.032101 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-18a63f16-4611-46e2-b631-e09862a6b081 req-f3e13af7-e119-4cc9-a3b9-eb7793f64628 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:48.032692 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-18a63f16-4611-46e2-b631-e09862a6b081 req-f3e13af7-e119-4cc9-a3b9-eb7793f64628 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:48.047529 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-18a63f16-4611-46e2-b631-e09862a6b081 req-f3e13af7-e119-4cc9-a3b9-eb7793f64628 service nova] Creating event network-changed:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:22:48.055229 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-18a63f16-4611-46e2-b631-e09862a6b081 req-f3e13af7-e119-4cc9-a3b9-eb7793f64628 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039680 Jul 20 09:22:48.056022 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 486/963] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:49.249651 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:49.250203 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:49.256622 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:49.257073 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:49.258202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:49.258652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:49.340219 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lazy-loading 'services' on Instance uuid 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:22:49.426438 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7dcbae3f-ea1d-44a4-a3a2-945f9cce1f09 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments/a9572589-03b3-4c1c-ad5f-dba073d6f154" status: 202 len: 0 microversion: 2.1 time: 0.180697 Jul 20 09:22:49.427236 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 478/964] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:22:49 2022] DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments/a9572589-03b3-4c1c-ad5f-dba073d6f154 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:22:49.436840 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:49.437950 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:49.445385 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:49.446215 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:49.447123 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:49.447631 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:49.480388 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-17c0a4c3-27eb-42c6-aa7d-ff3a6eb57ecb tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048547 Jul 20 09:22:49.481194 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 487/965] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:22:49 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:50.072330 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-b5ac74c3-698a-41c1-8f96-4d83ac91a18a req-2946e299-0d5a-480f-b457-d6628ab64996 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:50.081793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-b5ac74c3-698a-41c1-8f96-4d83ac91a18a req-2946e299-0d5a-480f-b457-d6628ab64996 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:50.082249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-b5ac74c3-698a-41c1-8f96-4d83ac91a18a req-2946e299-0d5a-480f-b457-d6628ab64996 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:50.094941 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-b5ac74c3-698a-41c1-8f96-4d83ac91a18a req-2946e299-0d5a-480f-b457-d6628ab64996 service nova] Creating event network-changed:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:22:50.100970 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-b5ac74c3-698a-41c1-8f96-4d83ac91a18a req-2946e299-0d5a-480f-b457-d6628ab64996 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032988 Jul 20 09:22:50.101580 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 479/966] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:50.492918 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:50.493769 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:50.500494 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:50.500950 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:50.501729 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:50.502170 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:50.533129 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-52e6305a-32f0-4cd7-99b7-29a0e874e5e0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044212 Jul 20 09:22:50.533701 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 488/967] 10.222.0.44 () {58 vars in 1301 bytes} [Wed Jul 20 09:22:50 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 20 09:22:50.546289 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:50.547142 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:50.553856 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:50.554306 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:50.555168 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:50.555671 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:50.635438 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] HTTP exception thrown: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 is not attached to volume a9572589-03b3-4c1c-ad5f-dba073d6f154 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Request method failure captured: Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments/a9572589-03b3-4c1c-ad5f-dba073d6f154 HTTP/1.1 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18jq2-p_0bkkQc2iKbVQ1AktDZzSbnv_0XcOIXh9fbvLTlNbCH_lJd_yrwAlUZFpBQ1FCuRBjBL7QW22mOcyItSpSBM0MYZFp2DqsAgIfTWsW3RzkxcocimuiK5bZm5EbsxChSnShaptbLs8a5Ffx-5JCWqfxfRzY3wN2DGkQxvQ3EY Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 96007c68c7f349a19f6bc8c16f024cc6 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestMinimumBasicScenario-9279885 Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:22:50.637912 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestMinimumBasicScenario-9279885 Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 96007c68c7f349a19f6bc8c16f024cc6 Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9279885 Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-TestMinimumBasicScenario-9279885-project Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 5a2f15a789f1482ba7a4ecbd260913ea Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestMinimumBasicScenario-9279885-project Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:22:50.640266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 is not attached to volume a9572589-03b3-4c1c-ad5f-dba073d6f154 Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'server_id': '81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3', 'id': 'a9572589-03b3-4c1c-ad5f-dba073d6f154'} Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a9572589-03b3-4c1c-ad5f-dba073d6f154. Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:22:50.641273 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 is not attached to volume a9572589-03b3-4c1c-ad5f-dba073d6f154 Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 is not attached to volume a9572589-03b3-4c1c-ad5f-dba073d6f154 Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:50.642858 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Returning 404 to user: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 is not attached to volume a9572589-03b3-4c1c-ad5f-dba073d6f154 {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:22:50.644193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-37864ba0-574e-4058-bad8-7763dbdb8ac0 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments/a9572589-03b3-4c1c-ad5f-dba073d6f154" status: 404 len: 154 microversion: 2.1 time: 0.100041 Jul 20 09:22:50.644193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 480/968] 10.222.0.44 () {58 vars in 1415 bytes} [Wed Jul 20 09:22:50 2022] DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3/os-volume_attachments/a9572589-03b3-4c1c-ad5f-dba073d6f154 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:22:51.771236 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:51.771723 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:51.778041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:51.778486 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:51.779836 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:51.780293 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:51.805180 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:22:51.879710 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8f4f0854-42ce-4f88-8e35-59cda1fc13f3 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 204 len: 0 microversion: 2.1 time: 0.111784 Jul 20 09:22:51.880423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 489/969] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:22:51 2022] DELETE /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:22:51.888663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:51.889277 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:51.895791 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:51.896236 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:51.897009 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:51.897443 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:52.027650 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:52.035852 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-75e9201d-63f2-4fbd-9af6-c80b81c43687 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1553 microversion: 2.1 time: 0.151078 Jul 20 09:22:52.036412 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 481/970] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:51 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:53.054659 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:53.055390 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:53.062502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:53.062985 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:53.063752 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:53.064198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:53.243507 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:53.251658 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-73f6ef01-92b4-4cba-925f-9d3ab8a563cf tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1553 microversion: 2.1 time: 0.201242 Jul 20 09:22:53.252267 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 490/971] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:53 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:54.097352 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-1215564a-4c73-4cae-a953-b563c0386454 req-be3ceea8-c391-4ebf-aca0-6f65957fd929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3", "name": "network-vif-deleted", "tag": "b7669c6d-76e8-446f-875d-bd0acc55abdb"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:22:54.105872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1215564a-4c73-4cae-a953-b563c0386454 req-be3ceea8-c391-4ebf-aca0-6f65957fd929 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:54.106314 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-1215564a-4c73-4cae-a953-b563c0386454 req-be3ceea8-c391-4ebf-aca0-6f65957fd929 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:54.117880 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-1215564a-4c73-4cae-a953-b563c0386454 req-be3ceea8-c391-4ebf-aca0-6f65957fd929 service nova] Creating event network-vif-deleted:b7669c6d-76e8-446f-875d-bd0acc55abdb for instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 on hv-cinder-84330 Jul 20 09:22:54.123062 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-1215564a-4c73-4cae-a953-b563c0386454 req-be3ceea8-c391-4ebf-aca0-6f65957fd929 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028791 Jul 20 09:22:54.123653 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 482/972] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:22:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:22:54.268269 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:54.268890 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:54.275414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:54.275869 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:54.276633 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:54.277089 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:54.309738 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:54.310155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:54.310602 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lazy-loading 'fault' on Instance uuid 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:22:54.350601 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a2f15a789f1482ba7a4ecbd260913ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96007c68c7f349a19f6bc8c16f024cc6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:22:54.358785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0ddec0c2-68bb-4b19-906a-81996a4a6c3c tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 200 len: 1348 microversion: 2.1 time: 0.094535 Jul 20 09:22:54.359358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 491/973] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:54 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 1348 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:22:55.377616 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:55.378317 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] [instance: 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:22:55.384535 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:55.384982 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:55.385745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:22:55.386186 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:22:55.399334 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] HTTP exception thrown: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 could not be found. Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Request method failure captured: Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 HTTP/1.1 Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18jq2-p_0bkkQc2iKbVQ1AktDZzSbnv_0XcOIXh9fbvLTlNbCH_lJd_yrwAlUZFpBQ1FCuRBjBL7QW22mOcyItSpSBM0MYZFp2DqsAgIfTWsW3RzkxcocimuiK5bZm5EbsxChSnShaptbLs8a5Ffx-5JCWqfxfRzY3wN2DGkQxvQ3EY Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: 96007c68c7f349a19f6bc8c16f024cc6 Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestMinimumBasicScenario-9279885 Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:22:55.400967 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/96007c68c7f349a19f6bc8c16f024cc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestMinimumBasicScenario-9279885 Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: 96007c68c7f349a19f6bc8c16f024cc6 Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestMinimumBasicScenario-9279885 Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-TestMinimumBasicScenario-9279885-project Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: 5a2f15a789f1482ba7a4ecbd260913ea Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestMinimumBasicScenario-9279885-project Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 could not be found. Jul 20 09:22:55.402554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3'} Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 could not be found. Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:22:55.403648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 could not be found. Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 could not be found. Jul 20 09:22:55.405465 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:22:55.406793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Returning 404 to user: Instance 81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:22:55.406793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-922b3562-4773-4334-9408-f9a76dbfcfb9 tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jul 20 09:22:55.406793 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 483/974] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:22:55 2022] GET /compute/v2.1/servers/81f7590d-2ccb-455a-9cf0-8cf2aa2da6c3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:22:55.411100 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0d8846d6-a4f0-45f2-9932-e3bce68e8a0a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] Calling method '.version_select at 0x7fadafa82d30>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:22:55.430438 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0d8846d6-a4f0-45f2-9932-e3bce68e8a0a tempest-TestMinimumBasicScenario-9279885 tempest-TestMinimumBasicScenario-9279885-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1476435398" status: 202 len: 0 microversion: 2.1 time: 0.023057 Jul 20 09:22:55.431045 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 492/975] 10.222.0.44 () {58 vars in 1271 bytes} [Wed Jul 20 09:22:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1476435398 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:23:12.939181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=14 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:12.940005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:13.116697 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b4a92b17-bd0f-4a73-9cb9-f37254768d6c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Action: 'create', calling method: .version_select at 0x7fadbc271ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-782341406", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRpM7o9U3a0l+oseGJcF7AtAeUat6Ujl3v0MEsGkdh7vVQDYG3fAkc2ddziL1O6qilBgDZKKYrL4CraXRQxRUzCQYb+AecYWbErH7f9MWMirBv4qA/MCo0dl+WaONpWUg=="}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:13.131745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-b4a92b17-bd0f-4a73-9cb9-f37254768d6c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for project a93c746bc7844fbfad63dc528ae346f7. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:23:13.135717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-b4a92b17-bd0f-4a73-9cb9-f37254768d6c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for user ae24e34d799e4db292be714fd49579c7 and project a93c746bc7844fbfad63dc528ae346f7. Resources: {'key_pairs'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:23:13.159724 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b4a92b17-bd0f-4a73-9cb9-f37254768d6c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.227319 Jul 20 09:23:13.160335 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 484/976] 10.222.0.44 () {60 vars in 1158 bytes} [Wed Jul 20 09:23:12 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:23:28.292553 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:28.293339 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:28.297998 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1596167293", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-782341406", "security_groups": [{"name": "tempest-secgroup-smoke-5254712"}], "block_device_mapping_v2": [{"uuid": "4f9083cc-6895-4023-93b1-b122a97fb262", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ac344e8-b02e-4117-bec3-6f60e2a2e235"}]}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:28.414428 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] validate_networks() for [('1ac344e8-b02e-4117-bec3-6f60e2a2e235', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:23:28.784548 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:23:28.784980 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:23:28.785453 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:23:28.785862 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:23:28.786275 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:23:28.795617 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:28.796068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:28.796897 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:28.797342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:28.814733 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for project a93c746bc7844fbfad63dc528ae346f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:23:28.818622 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for user ae24e34d799e4db292be714fd49579c7 and project a93c746bc7844fbfad63dc528ae346f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:23:28.875837 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:23:28.877913 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f9083cc-6895-4023-93b1-b122a97fb262',volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:23:29.002408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1d55f353-8c24-42f7-aed8-1aed16372009 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.711831 Jul 20 09:23:29.003246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 493/977] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:23:28 2022] POST /compute/v2.1/servers => generated 403 bytes in 713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:23:29.010619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=4 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.011585 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:29.015859 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-84252c96-985e-4d77-9863-be01df71191b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:29.016480 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-84252c96-985e-4d77-9863-be01df71191b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:29.079711 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-84252c96-985e-4d77-9863-be01df71191b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:29.086514 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-84252c96-985e-4d77-9863-be01df71191b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1094 microversion: 2.1 time: 0.077281 Jul 20 09:23:29.087112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 485/978] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:29 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1094 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:30.103358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:30.103970 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:30.110762 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:30.111217 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:30.111990 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:30.112422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:30.197668 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:30.206114 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6d5c97c7-425e-4538-a040-6421032621ac tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1210 microversion: 2.1 time: 0.107036 Jul 20 09:23:30.206697 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 494/979] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:30 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1210 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:31.223992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:31.224553 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:31.232311 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:31.232773 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:31.233571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:31.234016 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:31.370894 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:31.379511 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-74b1abc9-275e-4024-ae91-7bcf121fe3b0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.159642 Jul 20 09:23:31.380090 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 486/980] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:31 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:31.774795 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-5207cac6-ea26-4373-be00-3cbf9c94cade req-4058ba10-486d-4741-8034-ce5693ac7e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8dc7d7-3d0c-4234-906a-33859e21c0ef", "tag": "f92e66a7-61dd-4da3-9510-597092092632"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:31.784864 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-5207cac6-ea26-4373-be00-3cbf9c94cade req-4058ba10-486d-4741-8034-ce5693ac7e10 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:31.785318 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-5207cac6-ea26-4373-be00-3cbf9c94cade req-4058ba10-486d-4741-8034-ce5693ac7e10 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:31.797805 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-5207cac6-ea26-4373-be00-3cbf9c94cade req-4058ba10-486d-4741-8034-ce5693ac7e10 service nova] Creating event network-changed:f92e66a7-61dd-4da3-9510-597092092632 for instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef on hv-cinder-84330 Jul 20 09:23:31.802853 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-5207cac6-ea26-4373-be00-3cbf9c94cade req-4058ba10-486d-4741-8034-ce5693ac7e10 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100938 Jul 20 09:23:31.803697 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 495/981] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:23:32.396668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:32.397291 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:32.404565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:32.405035 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:32.405796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:32.406237 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:32.540731 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:32.549234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7fb68aad-2c0f-4625-b11c-a7f96ed976b1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.156521 Jul 20 09:23:32.549811 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 487/982] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:32 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:33.567105 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:33.567820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:33.574077 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:33.575122 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:33.575909 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:33.576612 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:33.706147 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:33.713598 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-bfa24510-7c6d-45b0-8123-d0cfda46065b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.151149 Jul 20 09:23:33.714164 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 496/983] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:33 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:34.730085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:34.731455 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:34.738243 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:34.738714 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:34.739494 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:34.739937 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:34.871562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:34.879003 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-3a19f99f-d4f6-4984-ba33-4f0849ba378f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.152773 Jul 20 09:23:34.879564 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 488/984] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:34 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:35.896570 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:35.897183 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:35.904143 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:35.904684 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:35.905451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:35.905882 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:36.035996 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:36.044112 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-db36c4ae-63d3-4d36-af28-49340d42bccc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.150855 Jul 20 09:23:36.044680 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 497/985] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:35 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:37.060792 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:37.061409 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:37.067944 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:37.068401 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:37.069205 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:37.069646 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:37.199100 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:37.207388 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-1ebe75af-0189-49eb-940d-7857147e99c8 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.150624 Jul 20 09:23:37.207952 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 489/986] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:37 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:38.224383 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:38.224948 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:38.232008 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:38.232452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:38.233210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:38.233643 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:38.369477 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:38.377081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e49d48e1-1152-4537-b018-2aa72e7be5cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.156603 Jul 20 09:23:38.377675 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 498/987] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:38 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:39.394445 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:39.395140 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:39.397264 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:39.403435 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:39.404160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:39.405193 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:39.405640 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:39.542753 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:39.551725 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-4419afdb-b89c-406f-bb5a-99f2c00b8b75 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.161210 Jul 20 09:23:39.552619 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 490/988] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:39 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:40.568968 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:40.569584 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:40.571751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:40.572396 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:40.579487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:40.579931 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:40.580688 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:40.581121 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:40.714397 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:40.721872 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-c8bd3e01-4ac3-4eaa-ba7a-e0dea5387a3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.156713 Jul 20 09:23:40.722434 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 499/989] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:40 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:41.237265 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-a4e13ca4-8900-45fd-b274-27c4afc8bec9 req-69bcb872-fc77-4fb7-920e-a9ec38de2296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8dc7d7-3d0c-4234-906a-33859e21c0ef", "name": "network-vif-plugged", "status": "completed", "tag": "f92e66a7-61dd-4da3-9510-597092092632"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:41.245359 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a4e13ca4-8900-45fd-b274-27c4afc8bec9 req-69bcb872-fc77-4fb7-920e-a9ec38de2296 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:41.245813 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-a4e13ca4-8900-45fd-b274-27c4afc8bec9 req-69bcb872-fc77-4fb7-920e-a9ec38de2296 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:41.257692 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-a4e13ca4-8900-45fd-b274-27c4afc8bec9 req-69bcb872-fc77-4fb7-920e-a9ec38de2296 service nova] Creating event network-vif-plugged:f92e66a7-61dd-4da3-9510-597092092632 for instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef on hv-cinder-84330 Jul 20 09:23:41.262927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-a4e13ca4-8900-45fd-b274-27c4afc8bec9 req-69bcb872-fc77-4fb7-920e-a9ec38de2296 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086105 Jul 20 09:23:41.263537 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 491/990] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:23:41.738518 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:41.739078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:41.745501 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:41.745947 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:41.746765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:41.747210 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:41.878742 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:41.886162 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-7d11655f-925d-4b7a-ad21-19e1955edc8d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1263 microversion: 2.1 time: 0.151577 Jul 20 09:23:41.886761 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 500/991] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:41 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:42.905050 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:42.905757 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:42.912016 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:42.912482 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:42.913234 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:42.913671 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:43.049548 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:43.057072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-db9d0592-3827-4219-ad23-a46069a40800 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1450 microversion: 2.1 time: 0.157324 Jul 20 09:23:43.057632 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 492/992] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:42 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:43.072849 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:43.073462 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:43.080179 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:43.080626 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:43.081386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:43.081824 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:43.211049 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:43.220228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-595952c7-4c44-40f5-8711-e77beaf5fd48 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1450 microversion: 2.1 time: 0.150330 Jul 20 09:23:43.220228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 501/993] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:43 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:45.044521 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-26bc1f7e-71ad-46ec-92de-f8c80213dac9 req-d9decae7-f12e-46b8-9e8f-2e83bde3b693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd8dc7d7-3d0c-4234-906a-33859e21c0ef", "tag": "f92e66a7-61dd-4da3-9510-597092092632"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:45.053206 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-26bc1f7e-71ad-46ec-92de-f8c80213dac9 req-d9decae7-f12e-46b8-9e8f-2e83bde3b693 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:45.053661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-26bc1f7e-71ad-46ec-92de-f8c80213dac9 req-d9decae7-f12e-46b8-9e8f-2e83bde3b693 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:45.064688 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-26bc1f7e-71ad-46ec-92de-f8c80213dac9 req-d9decae7-f12e-46b8-9e8f-2e83bde3b693 service nova] Creating event network-changed:f92e66a7-61dd-4da3-9510-597092092632 for instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef on hv-cinder-84330 Jul 20 09:23:45.069659 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-26bc1f7e-71ad-46ec-92de-f8c80213dac9 req-d9decae7-f12e-46b8-9e8f-2e83bde3b693 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029567 Jul 20 09:23:45.070249 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 493/994] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:23:54.625140 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:54.625705 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:54.628085 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-2cc63488-ce72-40a1-a597-bc1b18437d4e req-1ad7054d-cea7-4533-81b0-dcb946d56f71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:54.628517 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.629256 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=46 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:23:54.635499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:54.636471 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:54.637863 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2cc63488-ce72-40a1-a597-bc1b18437d4e req-1ad7054d-cea7-4533-81b0-dcb946d56f71 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:54.638406 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2cc63488-ce72-40a1-a597-bc1b18437d4e req-1ad7054d-cea7-4533-81b0-dcb946d56f71 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:54.638585 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:54.639363 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:54.650424 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-2cc63488-ce72-40a1-a597-bc1b18437d4e req-1ad7054d-cea7-4533-81b0-dcb946d56f71 service nova] Creating event network-changed:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:23:54.656988 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-2cc63488-ce72-40a1-a597-bc1b18437d4e req-1ad7054d-cea7-4533-81b0-dcb946d56f71 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033592 Jul 20 09:23:54.658012 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 494/995] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:23:54.666384 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Going to try to terminate instance {{(pid=117872) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:23:54.764736 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-fad7cf5a-cbb9-4f1a-909f-291f156b2f80 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "DELETE /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 204 len: 0 microversion: 2.1 time: 0.144629 Jul 20 09:23:54.765637 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 502/996] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:23:54 2022] DELETE /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:23:54.774232 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:54.774983 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:54.782241 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:54.783005 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:54.783802 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:54.784251 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:54.926228 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:54.933992 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b7f25aa2-ab25-4231-be5a-19021692e3dc tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.163830 Jul 20 09:23:54.934571 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 495/997] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:54 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:55.952420 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:55.953264 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:55.959720 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:55.960176 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:55.960958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:55.961405 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:56.093502 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:56.101135 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-9e385c56-3f91-45c2-bc9a-1fd54a3a0c2c tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1569 microversion: 2.1 time: 0.153248 Jul 20 09:23:56.101651 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 503/998] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:55 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:56.753380 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-16786ea7-c923-4159-b71b-6d50de370add req-94d76c4e-d886-49f0-907f-05ba2654c529 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15d7778e-9051-4436-a321-0a45cc1f8643", "name": "network-vif-deleted", "tag": "8ed037ca-c8c2-4ef6-9e32-e3363964cd32"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:23:56.768822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-16786ea7-c923-4159-b71b-6d50de370add req-94d76c4e-d886-49f0-907f-05ba2654c529 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:56.769269 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-16786ea7-c923-4159-b71b-6d50de370add req-94d76c4e-d886-49f0-907f-05ba2654c529 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:56.781267 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-16786ea7-c923-4159-b71b-6d50de370add req-94d76c4e-d886-49f0-907f-05ba2654c529 service nova] Creating event network-vif-deleted:8ed037ca-c8c2-4ef6-9e32-e3363964cd32 for instance 15d7778e-9051-4436-a321-0a45cc1f8643 on hv-cinder-84330 Jul 20 09:23:56.786648 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-16786ea7-c923-4159-b71b-6d50de370add req-94d76c4e-d886-49f0-907f-05ba2654c529 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036630 Jul 20 09:23:56.787123 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 496/999] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:23:57.119826 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:57.121232 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:57.129001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:57.129495 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:57.130381 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:57.131001 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:57.166470 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:57.167692 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:57.167692 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.objects.instance [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lazy-loading 'fault' on Instance uuid 15d7778e-9051-4436-a321-0a45cc1f8643 {{(pid=117872) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:23:57.214560 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcc742eb9e7b42d9bb41f04bb58038db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a9958d940546b99e37b85acc95ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:23:57.222962 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-089a31c8-1ff4-498c-a895-8d34d717c373 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 200 len: 1224 microversion: 2.1 time: 0.108671 Jul 20 09:23:57.223571 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 504/1000] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:57 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 1224 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:23:58.241796 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:58.242495 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] [instance: 15d7778e-9051-4436-a321-0a45cc1f8643] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:23:58.249495 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:58.249954 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:58.250785 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:23:58.251211 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:23:58.264898 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] HTTP exception thrown: Instance 15d7778e-9051-4436-a321-0a45cc1f8643 could not be found. Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Request method failure captured: Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 HTTP/1.1 Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18idb24rVYdnIqMfUtAR_J_xwPNlx99aN2u14EDqyN5BZ--5Nwu08cazUtgtb1P2iGZH0Ca05OuKBWJPAsZBe8gHNBusouM7LVzwZIR6RoQ8bbq1q28H8jxBeqFYjSDTBQCvZnZQ1Zasmv_pPcMNRr0BFJUnvY5UyRv92Eu0QrbhgpA Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: e6a9958d940546b99e37b85acc95ad7c Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestShelveInstance-1085554051 Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:23:58.266538 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/e6a9958d940546b99e37b85acc95ad7c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_e6a9958d940546b99e37b85acc95ad7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6a9958d940546b99e37b85acc95ad7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/e6a9958d940546b99e37b85acc95ad7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestShelveInstance-1085554051 Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: e6a9958d940546b99e37b85acc95ad7c Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestShelveInstance-1085554051 Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-TestShelveInstance-1085554051-project Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: bcc742eb9e7b42d9bb41f04bb58038db Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestShelveInstance-1085554051-project Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance 15d7778e-9051-4436-a321-0a45cc1f8643 could not be found. Jul 20 09:23:58.268333 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': '15d7778e-9051-4436-a321-0a45cc1f8643'} Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15d7778e-9051-4436-a321-0a45cc1f8643 could not be found. Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:23:58.269513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15d7778e-9051-4436-a321-0a45cc1f8643 could not be found. Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15d7778e-9051-4436-a321-0a45cc1f8643 could not be found. Jul 20 09:23:58.271229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:23:58.272794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Returning 404 to user: Instance 15d7778e-9051-4436-a321-0a45cc1f8643 could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:23:58.272794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-173820c0-b3a5-49c7-8df3-2f27a494ca72 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643" status: 404 len: 111 microversion: 2.1 time: 0.030875 Jul 20 09:23:58.272794 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 497/1001] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:23:58 2022] GET /compute/v2.1/servers/15d7778e-9051-4436-a321-0a45cc1f8643 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:23:58.428585 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-011df307-4712-41f1-ba99-0f1ed2a7da63 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] Calling method '.version_select at 0x7fadafb4f550>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:23:58.452960 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-011df307-4712-41f1-ba99-0f1ed2a7da63 tempest-TestShelveInstance-1085554051 tempest-TestShelveInstance-1085554051-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1964681893" status: 202 len: 0 microversion: 2.1 time: 0.028417 Jul 20 09:23:58.453842 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 505/1002] 10.222.0.44 () {58 vars in 1253 bytes} [Wed Jul 20 09:23:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1964681893 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:25:41.328737 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR oslo.messaging._drivers.impl_rabbit [-] [37090ef8-f05d-4357-bd2f-129aaac71e94] AMQP server on 10.222.0.44:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 20 09:25:41.329344 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=28 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:41.330921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=52 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:41.335100 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:41.335663 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:41.343349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:41.343803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:41.344634 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:41.345132 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:41.372526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:25:41.450530 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a9149b9c-9417-49de-b6ea-558d85579bdd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 204 len: 0 microversion: 2.1 time: 0.123943 Jul 20 09:25:41.451375 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 498/1003] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:25:41 2022] DELETE /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:25:41.458559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cee4ab31-befa-4b69-b8f6-4b1814a69f12] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 09:25:41.459182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:41.459878 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:41.464262 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:41.464881 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:41.475508 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:41.476044 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:41.476820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:41.477266 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:41.623394 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:41.632032 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-4186c870-1ad4-439e-afca-46dffdfdca53 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1575 microversion: 2.1 time: 0.175375 Jul 20 09:25:41.632639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 506/1004] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:41 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:42.649872 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:42.650627 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:42.659376 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:42.660077 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:42.660979 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:42.661432 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:42.667864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] [37090ef8-f05d-4357-bd2f-129aaac71e94] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 51768. Jul 20 09:25:42.795965 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:42.810968 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aa0e1242-3592-491f-92e9-4c2ba117f261 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1575 microversion: 2.1 time: 0.159026 Jul 20 09:25:42.810968 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 499/1005] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:42 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:43.798238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-c0a6fc1e-e7ac-498f-b80e-2781ba5a7e15 req-8ad83f69-bdad-4cdd-92a7-119156826ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd8dc7d7-3d0c-4234-906a-33859e21c0ef", "name": "network-vif-deleted", "tag": "f92e66a7-61dd-4da3-9510-597092092632"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:25:43.812337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-c0a6fc1e-e7ac-498f-b80e-2781ba5a7e15 req-8ad83f69-bdad-4cdd-92a7-119156826ecf service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:43.813028 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-c0a6fc1e-e7ac-498f-b80e-2781ba5a7e15 req-8ad83f69-bdad-4cdd-92a7-119156826ecf service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:43.822640 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:43.823296 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:43.830117 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-c0a6fc1e-e7ac-498f-b80e-2781ba5a7e15 req-8ad83f69-bdad-4cdd-92a7-119156826ecf service nova] Creating event network-vif-deleted:f92e66a7-61dd-4da3-9510-597092092632 for instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef on hv-cinder-84330 Jul 20 09:25:43.837314 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-c0a6fc1e-e7ac-498f-b80e-2781ba5a7e15 req-8ad83f69-bdad-4cdd-92a7-119156826ecf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042376 Jul 20 09:25:43.838251 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 507/1006] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:25:43.854148 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:43.858394 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:43.859745 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:43.860360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:43.938726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:43.948775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a3faf075-7551-4fbf-8a58-4b2ee543467b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 200 len: 1225 microversion: 2.1 time: 0.130356 Jul 20 09:25:43.949363 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 500/1007] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:43 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 1225 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:44.965516 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:44.966225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:44.968421 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO oslo.messaging._drivers.impl_rabbit [-] [cee4ab31-befa-4b69-b8f6-4b1814a69f12] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 51772. Jul 20 09:25:44.974646 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:44.975127 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:44.975910 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:44.976349 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:44.990997 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] HTTP exception thrown: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Request method failure captured: Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef HTTP/1.1 Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18l7Sy_oK6oyDKdRtE4c58wvNqjxRyp0s90-chrvBBs0ZHCiPTXRKOT8YJ9kOBw4F1hqTFjAljM165bMTevyjl0aEv1D9p_eMUc7DNvQ6TDhNhyab4YXvg7ryXNi9jrFITwxjx7vgi4lOvtBTEvlqLy65iaO7DliHa9-_MjGef9qrio Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:25:44.992630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: ae24e34d799e4db292be714fd49579c7 Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:25:44.994451 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'dd8dc7d7-3d0c-4234-906a-33859e21c0ef'} Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:25:44.995515 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:25:44.997177 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:25:44.998758 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Returning 404 to user: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:25:44.998758 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-60c7c222-b138-40dc-9886-bd757c9ea179 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 404 len: 111 microversion: 2.1 time: 0.032790 Jul 20 09:25:44.999122 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 508/1008] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:44 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:25:45.091243 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-413179006", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-782341406", "security_groups": [{"name": "tempest-secgroup-smoke-5254712"}], "block_device_mapping_v2": [{"uuid": "4f9083cc-6895-4023-93b1-b122a97fb262", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ac344e8-b02e-4117-bec3-6f60e2a2e235"}]}} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:25:45.208588 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.network.neutron [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] validate_networks() for [('1ac344e8-b02e-4117-bec3-6f60e2a2e235', None, None, None, None, None)] {{(pid=117871) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:25:45.685676 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Flavor limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:25:45.686108 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Image limits 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:25:45.686590 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Flavor pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:25:45.687060 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Image pref 0:0:0 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:25:45.687478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.virt.hardware [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117871) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:25:45.697038 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:45.697493 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:45.698299 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:45.698762 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:45.716916 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for project a93c746bc7844fbfad63dc528ae346f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:25:45.720933 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.quota [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for user ae24e34d799e4db292be714fd49579c7 and project a93c746bc7844fbfad63dc528ae346f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117871) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:25:45.788560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Going to run 1 instances... {{(pid=117871) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:25:45.790733 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f9083cc-6895-4023-93b1-b122a97fb262',volume_size=None,volume_type=None)] {{(pid=117871) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:25:45.918124 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-052ae8d6-947e-416b-9bd4-66e013370c59 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.830765 Jul 20 09:25:45.918800 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 501/1009] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:25:45 2022] POST /compute/v2.1/servers => generated 403 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:25:45.929780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-dc7ec01d-ab04-4e70-af07-ad5850da344d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:45.930398 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-dc7ec01d-ab04-4e70-af07-ad5850da344d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:45.985355 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-dc7ec01d-ab04-4e70-af07-ad5850da344d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:45.992826 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-dc7ec01d-ab04-4e70-af07-ad5850da344d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1093 microversion: 2.1 time: 0.067058 Jul 20 09:25:45.993668 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 509/1010] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:45 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:25:47.010201 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:47.010957 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:47.018207 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:47.018914 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:47.021186 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:47.021652 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:47.088726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:47.096607 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-00636ae7-c2ec-458f-97fb-1036da2fe5e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1209 microversion: 2.1 time: 0.090675 Jul 20 09:25:47.097227 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 502/1011] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:47 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:48.113988 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:48.114598 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:48.121830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:48.122278 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:48.123317 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:48.123504 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:48.156395 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-9aa554cc-b9d5-4b26-80bd-5dddac64fa9a req-2a40d50d-5b74-463d-919e-431f886bed8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80e619e-8aed-40c7-80b8-b34843369395", "tag": "7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:25:48.172229 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-9aa554cc-b9d5-4b26-80bd-5dddac64fa9a req-2a40d50d-5b74-463d-919e-431f886bed8a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:48.172945 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-9aa554cc-b9d5-4b26-80bd-5dddac64fa9a req-2a40d50d-5b74-463d-919e-431f886bed8a service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:48.191029 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-9aa554cc-b9d5-4b26-80bd-5dddac64fa9a req-2a40d50d-5b74-463d-919e-431f886bed8a service nova] Creating event network-changed:7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd for instance d80e619e-8aed-40c7-80b8-b34843369395 on hv-cinder-84330 Jul 20 09:25:48.196625 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-9aa554cc-b9d5-4b26-80bd-5dddac64fa9a req-2a40d50d-5b74-463d-919e-431f886bed8a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044515 Jul 20 09:25:48.198910 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 503/1012] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:25:48.521743 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:48.529783 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0130fb0d-d17a-4303-8eb3-557ea2e6dfcd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.419663 Jul 20 09:25:48.530473 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 510/1013] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:48 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:25:49.548750 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:49.550058 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:49.556367 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:49.556818 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:49.557581 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:49.558024 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:49.688926 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:49.697561 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-b32ea337-3920-4524-b2d2-dec58543bd4c tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.153536 Jul 20 09:25:49.698126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 504/1014] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:49 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:50.714225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:50.714868 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:50.722181 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:50.722624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:50.723408 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:50.723844 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:50.854067 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:50.861565 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-924eb469-c7c2-4bc8-85e6-92c57762cc13 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.151067 Jul 20 09:25:50.862148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 511/1015] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:50 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:51.877739 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:51.878348 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:51.884935 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:51.885382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:51.886141 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:51.886576 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:52.015382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:52.023450 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-db05abc9-4b0e-480c-864c-2860d2b790f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.149713 Jul 20 09:25:52.024006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 505/1016] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:51 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:53.040400 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:53.041006 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:53.047624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:53.048081 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:53.048846 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:53.049923 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:53.181302 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:53.188857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-17e82773-f928-4211-abf1-757c2f28ede1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.152338 Jul 20 09:25:53.189426 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 512/1017] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:53 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:54.206250 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:54.206915 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:54.213433 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:54.213888 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:54.214644 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:54.215112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:54.349179 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:54.357860 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-e1a71ef7-3b9a-4198-ad28-ba8a9a8a50a6 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.155900 Jul 20 09:25:54.358661 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 506/1018] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:54 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:55.374983 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:55.375610 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:55.383087 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:55.383541 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:55.384311 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:55.384749 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:55.514126 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:55.522120 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-a0ca285a-8e37-477c-9be3-46924b8ed0ea tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.151049 Jul 20 09:25:55.522681 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 513/1019] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:55 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:56.538971 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:56.539600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:56.542096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:56.542817 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=6 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:56.548533 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:56.549533 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:56.550313 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:56.550783 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:56.688203 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:56.696266 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-030b84e1-6784-4249-b919-a14e17c5d9e3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.161335 Jul 20 09:25:56.696824 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 507/1020] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:56 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:57.712567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:57.713189 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:57.715069 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:25:57.720832 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:57.721290 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:57.722068 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:57.722506 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:57.857109 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:57.864899 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-83b132a8-207e-43bb-ae5b-c6c33add1a8f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.156174 Jul 20 09:25:57.865467 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 514/1021] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:57 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:25:58.881499 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:25:58.882112 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:25:58.888697 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:58.889145 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:58.889903 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:25:58.890338 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:25:59.019679 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:25:59.026990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8c49c355-d81a-4b04-9573-365a494e07f4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.149354 Jul 20 09:25:59.027554 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 508/1022] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:25:58 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:26:00.044922 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:26:00.045602 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:26:00.050866 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-38d0d4dd-172b-406d-987f-a2a270a4de75 req-683c4a7b-1269-4d7c-9beb-d61a0923d8ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80e619e-8aed-40c7-80b8-b34843369395", "name": "network-vif-plugged", "status": "completed", "tag": "7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:26:00.060105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:00.060565 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:00.060780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-38d0d4dd-172b-406d-987f-a2a270a4de75 req-683c4a7b-1269-4d7c-9beb-d61a0923d8ff service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:00.061336 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-38d0d4dd-172b-406d-987f-a2a270a4de75 req-683c4a7b-1269-4d7c-9beb-d61a0923d8ff service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:00.061472 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:00.061779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:00.073884 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-38d0d4dd-172b-406d-987f-a2a270a4de75 req-683c4a7b-1269-4d7c-9beb-d61a0923d8ff service nova] Creating event network-vif-plugged:7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd for instance d80e619e-8aed-40c7-80b8-b34843369395 on hv-cinder-84330 Jul 20 09:26:00.079489 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-38d0d4dd-172b-406d-987f-a2a270a4de75 req-683c4a7b-1269-4d7c-9beb-d61a0923d8ff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043124 Jul 20 09:26:00.081116 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 515/1023] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:26:00.200172 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:26:00.208726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-862a1088-2c06-4302-a401-61caf58079ab tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.167733 Jul 20 09:26:00.209500 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 509/1024] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:26:00 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:26:01.228239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:26:01.229926 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:26:01.237052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:01.237522 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:01.238303 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:01.238765 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:01.380422 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:26:01.387902 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-f7bb73cb-d1cd-4f72-8873-66491c6fb181 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1262 microversion: 2.1 time: 0.164044 Jul 20 09:26:01.388452 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 516/1025] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:26:01 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1262 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:26:02.404947 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:26:02.405603 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:26:02.412318 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:02.412779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:02.413556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:02.414006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:02.545153 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:26:02.553577 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-6e123241-85b5-496b-bc1f-8a6afde18043 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1450 microversion: 2.1 time: 0.152477 Jul 20 09:26:02.554304 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 510/1026] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:26:02 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1450 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:26:02.570533 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:26:02.571182 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:26:02.577879 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:02.578328 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:02.579120 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:02.579559 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:02.713358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:26:02.720958 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-eb55dbd0-d087-48a1-b437-370bfc626871 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1450 microversion: 2.1 time: 0.154270 Jul 20 09:26:02.721613 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 517/1027] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:26:02 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1450 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:26:04.278480 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [req-2d31849b-244a-4c2f-b070-489b55cb29d2 req-0cdd300d-ebbf-4282-adaa-a372e9bf1109 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80e619e-8aed-40c7-80b8-b34843369395", "tag": "7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd"}]} {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:26:04.287921 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2d31849b-244a-4c2f-b070-489b55cb29d2 req-0cdd300d-ebbf-4282-adaa-a372e9bf1109 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:26:04.288455 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [req-2d31849b-244a-4c2f-b070-489b55cb29d2 req-0cdd300d-ebbf-4282-adaa-a372e9bf1109 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:26:04.300674 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.compute.server_external_events [req-2d31849b-244a-4c2f-b070-489b55cb29d2 req-0cdd300d-ebbf-4282-adaa-a372e9bf1109 service nova] Creating event network-changed:7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd for instance d80e619e-8aed-40c7-80b8-b34843369395 on hv-cinder-84330 Jul 20 09:26:04.306042 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [req-2d31849b-244a-4c2f-b070-489b55cb29d2 req-0cdd300d-ebbf-4282-adaa-a372e9bf1109 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031238 Jul 20 09:26:04.306806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 511/1028] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:26:19.039567 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:26:19.040198 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Wed Jul 20 09:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:26:28.764909 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:26:28.765560 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:26:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:27:39.615759 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=26 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:39.616557 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=54 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:39.620887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1552450196", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-782341406", "security_groups": [{"name": "tempest-secgroup-smoke-5254712"}], "block_device_mapping_v2": [{"uuid": "45b054ec-58bf-4749-b380-0e2bd94aac34", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1ac344e8-b02e-4117-bec3-6f60e2a2e235"}]}} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:27:39.732008 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.network.neutron [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] validate_networks() for [('1ac344e8-b02e-4117-bec3-6f60e2a2e235', None, None, None, None, None)] {{(pid=117872) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 20 09:27:40.134279 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Flavor limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 20 09:27:40.134732 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Image limits 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 20 09:27:40.135211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Flavor pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 20 09:27:40.135619 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Image pref 0:0:0 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 20 09:27:40.136030 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.virt.hardware [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117872) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 20 09:27:40.144784 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:40.145231 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:40.146592 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:40.147052 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:40.163386 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for project a93c746bc7844fbfad63dc528ae346f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 20 09:27:40.167358 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.quota [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Getting quotas for user ae24e34d799e4db292be714fd49579c7 and project a93c746bc7844fbfad63dc528ae346f7. Resources: {'ram', 'cores', 'instances'} {{(pid=117872) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 20 09:27:40.223741 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Going to run 1 instances... {{(pid=117872) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 20 09:27:40.226029 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='45b054ec-58bf-4749-b380-0e2bd94aac34',volume_size=None,volume_type=None)] {{(pid=117872) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 20 09:27:40.349000 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3af08bed-92b6-4ce9-a6d8-7e6fcd03d9fa tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.734837 Jul 20 09:27:40.353658 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 518/1029] 10.222.0.44 () {60 vars in 1146 bytes} [Wed Jul 20 09:27:39 2022] POST /compute/v2.1/servers => generated 403 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 20 09:27:40.357720 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:40.358462 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:40.362946 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-dd0f9579-7efc-45ec-960a-c0243f6c1da9 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:40.363977 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-dd0f9579-7efc-45ec-960a-c0243f6c1da9 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:40.423422 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-dd0f9579-7efc-45ec-960a-c0243f6c1da9 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:40.431297 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-dd0f9579-7efc-45ec-960a-c0243f6c1da9 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1094 microversion: 2.1 time: 0.075512 Jul 20 09:27:40.431957 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 512/1030] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:40 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:41.449520 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:41.450124 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:41.456496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:41.456942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:41.457740 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:41.458877 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:41.529874 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:41.537474 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-147055c0-d3cb-48c1-89c0-53142199f23f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1210 microversion: 2.1 time: 0.092340 Jul 20 09:27:41.538367 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 519/1031] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:41 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:42.555126 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:42.557956 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:42.566319 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:42.567160 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:42.568615 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:42.574831 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-faac856f-8132-40c1-bb44-a6a7b3fbc2e2 req-e98220cc-5b88-4151-ba6f-e93f116a9185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21c7849-8fb5-4128-9ced-cecdc2c81c7d", "tag": "5cf572e8-92ab-4339-b3ed-6b5b26a031d3"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:27:42.581546 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:42.598810 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-faac856f-8132-40c1-bb44-a6a7b3fbc2e2 req-e98220cc-5b88-4151-ba6f-e93f116a9185 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:42.601737 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-faac856f-8132-40c1-bb44-a6a7b3fbc2e2 req-e98220cc-5b88-4151-ba6f-e93f116a9185 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:42.618330 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-faac856f-8132-40c1-bb44-a6a7b3fbc2e2 req-e98220cc-5b88-4151-ba6f-e93f116a9185 service nova] Creating event network-changed:5cf572e8-92ab-4339-b3ed-6b5b26a031d3 for instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d on hv-cinder-84330 Jul 20 09:27:42.627003 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-faac856f-8132-40c1-bb44-a6a7b3fbc2e2 req-e98220cc-5b88-4151-ba6f-e93f116a9185 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056185 Jul 20 09:27:42.628542 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 520/1032] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:27:42.752240 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:42.763289 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-ee78b8ce-7d19-4053-8873-f7f2cedd639a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.211011 Jul 20 09:27:42.764228 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 513/1033] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:42 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:43.781583 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:43.782287 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:43.788580 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:43.789035 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:43.789796 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:43.790239 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:43.919410 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:43.927259 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-0e822c79-bec6-4e22-b512-e3589a0a02f5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.149767 Jul 20 09:27:43.928220 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 521/1034] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:43 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:44.943998 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:44.944697 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:44.951269 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:44.951717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:44.952478 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:44.953181 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:45.085048 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:45.092638 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9cddc544-bfe3-49f4-9410-5db2ad8e197e tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.152575 Jul 20 09:27:45.093211 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 514/1035] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:44 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:27:46.109201 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:46.109813 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:46.116873 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:46.117322 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:46.118078 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:46.118513 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:46.246415 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:46.253816 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-e5248aba-ff27-4572-a540-93bc8789ca14 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.148421 Jul 20 09:27:46.254372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 522/1036] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:46 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:47.270804 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:47.271413 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:47.277828 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:47.278271 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:47.279072 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:47.279510 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:47.521456 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:47.528779 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-57098ac4-00d1-4049-a613-cb2c6ac20e15 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.262053 Jul 20 09:27:47.529342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 515/1037] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:47 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:48.545570 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:48.546132 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:48.553228 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:48.553887 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:48.554434 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:48.554919 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:48.686666 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:48.694433 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8e597c97-38f9-4c94-8ac4-1965d05ff821 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.152762 Jul 20 09:27:48.695047 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 523/1038] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:48 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:49.710562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:49.711199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:49.717669 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:49.718118 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:49.718907 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:49.719342 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:49.849109 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:49.856631 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-fc211b27-68b6-4202-9a6c-e7fda898a5a5 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.149973 Jul 20 09:27:49.857202 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 516/1039] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:49 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:50.873368 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:50.873980 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:50.876450 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=2 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:50.877271 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell0:SELECT=6 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:50.884414 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:50.884859 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:50.885634 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:50.886069 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:51.017820 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:51.025830 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6d4e6bed-526d-43ba-b150-d7abf77c7ed0 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.156372 Jul 20 09:27:51.026384 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 524/1040] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:50 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:52.042838 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:52.043461 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:52.045387 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell0:SELECT=2 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:27:52.052562 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:52.053024 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:52.053803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:52.054254 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:52.182999 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:52.190354 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-9701d06c-6fcb-4030-a4c8-c8c6e1018b93 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.151380 Jul 20 09:27:52.190949 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 517/1041] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:52 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:52.485211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-2c0b40d5-9e14-4530-be35-f9ed6b8b5947 req-cc64d2fc-ec30-4ce2-b754-9bf5d5ea9d8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21c7849-8fb5-4128-9ced-cecdc2c81c7d", "name": "network-vif-plugged", "status": "completed", "tag": "5cf572e8-92ab-4339-b3ed-6b5b26a031d3"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:27:52.494400 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-2c0b40d5-9e14-4530-be35-f9ed6b8b5947 req-cc64d2fc-ec30-4ce2-b754-9bf5d5ea9d8b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:52.494915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-2c0b40d5-9e14-4530-be35-f9ed6b8b5947 req-cc64d2fc-ec30-4ce2-b754-9bf5d5ea9d8b service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:52.505835 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-2c0b40d5-9e14-4530-be35-f9ed6b8b5947 req-cc64d2fc-ec30-4ce2-b754-9bf5d5ea9d8b service nova] Creating event network-vif-plugged:5cf572e8-92ab-4339-b3ed-6b5b26a031d3 for instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d on hv-cinder-84330 Jul 20 09:27:52.510759 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-2c0b40d5-9e14-4530-be35-f9ed6b8b5947 req-cc64d2fc-ec30-4ce2-b754-9bf5d5ea9d8b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029295 Jul 20 09:27:52.511370 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 525/1042] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:27:53.207850 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:53.208471 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:53.215629 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:53.216080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:53.216845 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:53.217281 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:53.354961 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:53.362755 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8cdefe7f-feb7-4290-b184-0458faf9ec39 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1263 microversion: 2.1 time: 0.159719 Jul 20 09:27:53.363323 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 518/1043] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:53 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:54.381970 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:54.382671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:54.388857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:54.389305 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:54.390063 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:54.390496 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:54.570252 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:54.578130 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-05399529-bf49-4bbb-95dd-2414c3fd9eba tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1450 microversion: 2.1 time: 0.201347 Jul 20 09:27:54.578782 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 526/1044] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:54 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1450 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:54.593902 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:27:54.594516 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:27:54.601152 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:54.601600 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:54.602358 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:54.602835 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:54.732382 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:27:54.740601 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8c367829-7e34-468c-adf6-d98dbc73840d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1450 microversion: 2.1 time: 0.150577 Jul 20 09:27:54.741161 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 519/1045] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:27:54 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:27:55.779323 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:27:55.780011 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:27:56.599785 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-e5cb5b93-2503-4b23-bc2b-8a1a66d9a907 req-87bb94e7-7113-4d0b-8737-61df403048c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21c7849-8fb5-4128-9ced-cecdc2c81c7d", "tag": "5cf572e8-92ab-4339-b3ed-6b5b26a031d3"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:27:56.607673 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-e5cb5b93-2503-4b23-bc2b-8a1a66d9a907 req-87bb94e7-7113-4d0b-8737-61df403048c9 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:27:56.608113 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-e5cb5b93-2503-4b23-bc2b-8a1a66d9a907 req-87bb94e7-7113-4d0b-8737-61df403048c9 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:27:56.619461 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-e5cb5b93-2503-4b23-bc2b-8a1a66d9a907 req-87bb94e7-7113-4d0b-8737-61df403048c9 service nova] Creating event network-changed:5cf572e8-92ab-4339-b3ed-6b5b26a031d3 for instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d on hv-cinder-84330 Jul 20 09:27:56.624699 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-e5cb5b93-2503-4b23-bc2b-8a1a66d9a907 req-87bb94e7-7113-4d0b-8737-61df403048c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086906 Jul 20 09:27:56.625499 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 527/1046] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:28:16.149513 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:28:16.150010 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:28:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:29:24.652717 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_api:SELECT=18 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:24.653864 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG dbcounter [-] [117871] Writing DB stats nova_cell1:SELECT=42 {{(pid=117871) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:24.654942 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:24.655858 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG dbcounter [-] [117872] Writing DB stats nova_cell1:SELECT=44 {{(pid=117872) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 09:29:24.658668 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:24.659975 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:24.660671 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-0af9b9be-bd65-455b-aafd-2e8b94c6d569 req-9d46d033-60ed-4f65-838a-df5bd351f216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21c7849-8fb5-4128-9ced-cecdc2c81c7d", "tag": "5cf572e8-92ab-4339-b3ed-6b5b26a031d3"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:24.667900 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:24.668729 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:24.669775 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:24.670526 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:24.670764 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-0af9b9be-bd65-455b-aafd-2e8b94c6d569 req-9d46d033-60ed-4f65-838a-df5bd351f216 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:24.671246 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-0af9b9be-bd65-455b-aafd-2e8b94c6d569 req-9d46d033-60ed-4f65-838a-df5bd351f216 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:24.683590 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-0af9b9be-bd65-455b-aafd-2e8b94c6d569 req-9d46d033-60ed-4f65-838a-df5bd351f216 service nova] Creating event network-changed:5cf572e8-92ab-4339-b3ed-6b5b26a031d3 for instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d on hv-cinder-84330 Jul 20 09:29:24.689048 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-0af9b9be-bd65-455b-aafd-2e8b94c6d569 req-9d46d033-60ed-4f65-838a-df5bd351f216 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036288 Jul 20 09:29:24.690059 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 528/1047] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:24.702096 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:29:24.786738 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-071c223d-b746-44fc-a371-c41884b05f4d tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 204 len: 0 microversion: 2.1 time: 0.135887 Jul 20 09:29:24.787683 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 520/1048] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:29:24 2022] DELETE /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:29:24.800036 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:24.801683 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:24.808993 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:24.809772 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:24.810624 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:24.811161 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:24.955290 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:29:24.963620 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-8b32d243-21cb-4412-b267-0f2da566f3cc tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1575 microversion: 2.1 time: 0.170675 Jul 20 09:29:24.965145 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 529/1049] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:24 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1575 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:29:25.983093 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:25.983801 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:25.991415 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:25.991868 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:25.992635 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:25.993067 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:26.125606 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:29:26.134262 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-7b2c7e17-6195-4ded-bbbe-dd1a5c46ab3b tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1575 microversion: 2.1 time: 0.155395 Jul 20 09:29:26.134882 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 521/1050] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:25 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:29:26.854532 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-164a492a-024d-49b6-bee8-7931b27fd034 req-17d8ff2c-a81c-41ce-a475-5c1d859e6258 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21c7849-8fb5-4128-9ced-cecdc2c81c7d", "name": "network-vif-deleted", "tag": "5cf572e8-92ab-4339-b3ed-6b5b26a031d3"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:26.863487 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-164a492a-024d-49b6-bee8-7931b27fd034 req-17d8ff2c-a81c-41ce-a475-5c1d859e6258 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:26.863922 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-164a492a-024d-49b6-bee8-7931b27fd034 req-17d8ff2c-a81c-41ce-a475-5c1d859e6258 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:26.874966 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-164a492a-024d-49b6-bee8-7931b27fd034 req-17d8ff2c-a81c-41ce-a475-5c1d859e6258 service nova] Creating event network-vif-deleted:5cf572e8-92ab-4339-b3ed-6b5b26a031d3 for instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d on hv-cinder-84330 Jul 20 09:29:26.880377 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-164a492a-024d-49b6-bee8-7931b27fd034 req-17d8ff2c-a81c-41ce-a475-5c1d859e6258 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093883 Jul 20 09:29:26.881157 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 530/1051] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:27.152307 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:27.152939 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:27.159855 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:27.160542 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:27.161368 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:27.161822 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:27.195901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:27.196360 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:27.196825 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lazy-loading 'fault' on Instance uuid a21c7849-8fb5-4128-9ced-cecdc2c81c7d {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:29:27.237410 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:29:27.245356 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-0a54c425-c217-445c-81ea-d56dd4371b4f tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 200 len: 1230 microversion: 2.1 time: 0.097472 Jul 20 09:29:27.245927 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 522/1052] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:27 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 1230 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 20 09:29:28.263296 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:28.264025 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: a21c7849-8fb5-4128-9ced-cecdc2c81c7d] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:28.271611 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:28.272071 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:28.272857 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:28.273301 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:28.287372 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] HTTP exception thrown: Instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d could not be found. Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Request method failure captured: Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d HTTP/1.1 Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18l7Sy_oK6oyDKdRtE4c58wvNqjxRyp0s90-chrvBBs0ZHCiPTXRKOT8YJ9kOBw4F1hqTFjAljM165bMTevyjl0aEv1D9p_eMUc7DNvQ6TDhNhyab4YXvg7ryXNi9jrFITwxjx7vgi4lOvtBTEvlqLy65iaO7DliHa9-_MjGef9qrio Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:29:28.288994 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: ae24e34d799e4db292be714fd49579c7 Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d could not be found. Jul 20 09:29:28.290803 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'a21c7849-8fb5-4128-9ced-cecdc2c81c7d'} Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d could not be found. Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:28.291818 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d could not be found. Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d could not be found. Jul 20 09:29:28.293472 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:28.294915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Returning 404 to user: Instance a21c7849-8fb5-4128-9ced-cecdc2c81c7d could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:28.294915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-6323f494-aab5-4692-9b5e-5ca5d7bd2bd4 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d" status: 404 len: 111 microversion: 2.1 time: 0.031798 Jul 20 09:29:28.294915 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 531/1053] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:28 2022] GET /compute/v2.1/servers/a21c7849-8fb5-4128-9ced-cecdc2c81c7d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:29:31.361199 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:31.361726 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:31.364337 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-bbddf9d1-110a-431d-8b4a-c49da3313f4f req-b7633639-788b-44d3-aa90-c1dc508d5fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80e619e-8aed-40c7-80b8-b34843369395", "tag": "7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:31.368670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:31.369990 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:31.370901 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:31.371349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:31.373110 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-bbddf9d1-110a-431d-8b4a-c49da3313f4f req-b7633639-788b-44d3-aa90-c1dc508d5fd5 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:31.373662 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-bbddf9d1-110a-431d-8b4a-c49da3313f4f req-b7633639-788b-44d3-aa90-c1dc508d5fd5 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:31.385573 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-bbddf9d1-110a-431d-8b4a-c49da3313f4f req-b7633639-788b-44d3-aa90-c1dc508d5fd5 service nova] Creating event network-changed:7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd for instance d80e619e-8aed-40c7-80b8-b34843369395 on hv-cinder-84330 Jul 20 09:29:31.390707 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-bbddf9d1-110a-431d-8b4a-c49da3313f4f req-b7633639-788b-44d3-aa90-c1dc508d5fd5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030489 Jul 20 09:29:31.391683 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 532/1054] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:31.399059 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Going to try to terminate instance {{(pid=117871) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 20 09:29:31.491105 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-8d3e9253-a84f-4301-97ca-f6c5b88e040a tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "DELETE /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 204 len: 0 microversion: 2.1 time: 0.133415 Jul 20 09:29:31.494751 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 523/1055] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:29:31 2022] DELETE /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 20 09:29:31.502038 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:31.502890 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:31.512670 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:31.513142 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:31.515169 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:31.515627 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:31.666690 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.policy [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117872) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:29:31.674630 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-ac721c43-604c-4c42-9356-aa96f86fd8dd tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1574 microversion: 2.1 time: 0.177719 Jul 20 09:29:31.675342 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 533/1056] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:31 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:29:32.693331 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:32.693978 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:32.700593 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:32.701049 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:32.701868 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:32.702282 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:32.861039 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:29:32.870404 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-aee19f64-b4bd-4098-abfc-9f8cde8d3f01 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1574 microversion: 2.1 time: 0.181979 Jul 20 09:29:32.871025 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 524/1057] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:32 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:29:33.424211 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [req-52ab7d6d-7532-4b2e-b62d-48bfde5194f6 req-386cdcff-331a-44eb-94eb-dc43ba078de2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80e619e-8aed-40c7-80b8-b34843369395", "name": "network-vif-deleted", "tag": "7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd"}]} {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 20 09:29:33.436275 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-52ab7d6d-7532-4b2e-b62d-48bfde5194f6 req-386cdcff-331a-44eb-94eb-dc43ba078de2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:33.436720 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [req-52ab7d6d-7532-4b2e-b62d-48bfde5194f6 req-386cdcff-331a-44eb-94eb-dc43ba078de2 service nova] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:33.450739 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.compute.server_external_events [req-52ab7d6d-7532-4b2e-b62d-48bfde5194f6 req-386cdcff-331a-44eb-94eb-dc43ba078de2 service nova] Creating event network-vif-deleted:7e4a9b5d-f315-4aed-a67e-96ec51a0a8fd for instance d80e619e-8aed-40c7-80b8-b34843369395 on hv-cinder-84330 Jul 20 09:29:33.457041 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [req-52ab7d6d-7532-4b2e-b62d-48bfde5194f6 req-386cdcff-331a-44eb-94eb-dc43ba078de2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037175 Jul 20 09:29:33.457639 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 534/1058] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Jul 20 09:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 20 09:29:33.705652 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:29:33.706238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Wed Jul 20 09:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:29:33.888343 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:33.888857 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:33.895780 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:33.896233 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:33.897006 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:33.897444 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:33.929385 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:33.929839 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:33.930295 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.objects.instance [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lazy-loading 'fault' on Instance uuid d80e619e-8aed-40c7-80b8-b34843369395 {{(pid=117871) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 20 09:29:33.973803 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.policy [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae24e34d799e4db292be714fd49579c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a93c746bc7844fbfad63dc528ae346f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117871) authorize /opt/stack/nova/nova/policy.py:199}} Jul 20 09:29:33.981679 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-d42ae697-9072-4f78-a170-43a4430159e1 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 200 len: 1229 microversion: 2.1 time: 0.097249 Jul 20 09:29:33.982260 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 525/1059] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:33 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 20 09:29:34.999468 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:35.000173 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: d80e619e-8aed-40c7-80b8-b34843369395] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:35.007075 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:35.007525 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:35.008289 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:35.008722 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:35.022174 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] HTTP exception thrown: Instance d80e619e-8aed-40c7-80b8-b34843369395 could not be found. Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Request method failure captured: Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 HTTP/1.1 Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18l7Sy_oK6oyDKdRtE4c58wvNqjxRyp0s90-chrvBBs0ZHCiPTXRKOT8YJ9kOBw4F1hqTFjAljM165bMTevyjl0aEv1D9p_eMUc7DNvQ6TDhNhyab4YXvg7ryXNi9jrFITwxjx7vgi4lOvtBTEvlqLy65iaO7DliHa9-_MjGef9qrio Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:29:35.023780 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: ae24e34d799e4db292be714fd49579c7 Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance d80e619e-8aed-40c7-80b8-b34843369395 could not be found. Jul 20 09:29:35.025509 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'd80e619e-8aed-40c7-80b8-b34843369395'} Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80e619e-8aed-40c7-80b8-b34843369395 could not be found. Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:35.026552 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80e619e-8aed-40c7-80b8-b34843369395 could not be found. Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80e619e-8aed-40c7-80b8-b34843369395 could not be found. Jul 20 09:29:35.028148 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.029763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Returning 404 to user: Instance d80e619e-8aed-40c7-80b8-b34843369395 could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:35.029763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-1ab6936c-3674-43ec-a8b9-3c792d266ae3 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395" status: 404 len: 111 microversion: 2.1 time: 0.029966 Jul 20 09:29:35.029763 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 535/1060] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:34 2022] GET /compute/v2.1/servers/d80e619e-8aed-40c7-80b8-b34843369395 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:29:35.448349 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:35.448903 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.compute.api [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117871) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:35.457355 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:35.457806 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:35.458578 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:35.459044 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG oslo_concurrency.lockutils [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117871) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:35.472670 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.wsgi [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] HTTP exception thrown: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Request method failure captured: Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: request: DELETE /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef HTTP/1.1 Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept: application/json Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Accept-Encoding: identity Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Connection: close Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Length: 0 Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Content-Type: application/json Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Host: 10.222.0.44 Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Openstack-System-Scope: None Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: User-Agent: python-urllib3/1.26.9 Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Auth-Token: gAAAAABi18l7Sy_oK6oyDKdRtE4c58wvNqjxRyp0s90-chrvBBs0ZHCiPTXRKOT8YJ9kOBw4F1hqTFjAljM165bMTevyjl0aEv1D9p_eMUc7DNvQ6TDhNhyab4YXvg7ryXNi9jrFITwxjx7vgi4lOvtBTEvlqLy65iaO7DliHa9-_MjGef9qrio Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Id: None Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Domain-Name: None Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Identity-Status: Confirmed Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Is-Admin-Project: True Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Id: default Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Domain-Name: Default Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Project-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Role: reader,member Jul 20 09:29:35.474332 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Roles: reader,member Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-Tenant-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Id: default Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Domain-Name: Default Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Id: ae24e34d799e4db292be714fd49579c7 Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: X-User-Name: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: method: > Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: exception: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.476070 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: action_args: {'id': 'dd8dc7d7-3d0c-4234-906a-33859e21c0ef'} Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:35.477027 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.478618 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.480253 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Returning 404 to user: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. {{(pid=117871) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:35.480253 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-68ac4e7d-6b16-4089-bb49-1a523d8470ce tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "DELETE /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 404 len: 111 microversion: 2.1 time: 0.031329 Jul 20 09:29:35.480253 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 526/1061] 10.222.0.44 () {58 vars in 1238 bytes} [Wed Jul 20 09:29:35 2022] DELETE /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:29:35.484679 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '>' {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:35.485419 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.compute.api [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [instance: dd8dc7d7-3d0c-4234-906a-33859e21c0ef] Fetching instance by UUID {{(pid=117872) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 20 09:29:35.491751 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:35.492199 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:35.492954 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 20 09:29:35.493387 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG oslo_concurrency.lockutils [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Lock "7c0f58ca-e0b2-4cd6-9bb6-e4a9c6ef49ea" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117872) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 20 09:29:35.507143 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.wsgi [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] HTTP exception thrown: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Request method failure captured: Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: request: GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef HTTP/1.1 Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept: application/json Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Accept-Encoding: identity Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Connection: close Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Length: 0 Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Content-Type: application/json Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Host: 10.222.0.44 Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Openstack-System-Scope: None Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: User-Agent: python-urllib3/1.26.9 Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Auth-Token: gAAAAABi18l7Sy_oK6oyDKdRtE4c58wvNqjxRyp0s90-chrvBBs0ZHCiPTXRKOT8YJ9kOBw4F1hqTFjAljM165bMTevyjl0aEv1D9p_eMUc7DNvQ6TDhNhyab4YXvg7ryXNi9jrFITwxjx7vgi4lOvtBTEvlqLy65iaO7DliHa9-_MjGef9qrio Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Id: None Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Domain-Name: None Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Identity-Status: Confirmed Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Is-Admin-Project: True Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Id: default Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Domain-Name: Default Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Project-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Role: reader,member Jul 20 09:29:35.508621 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Roles: reader,member Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.44:8080", "publicURL": "http://10.222.0.44:8080/v1/AUTH_a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/a93c746bc7844fbfad63dc528ae346f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/"}]}] Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Id: a93c746bc7844fbfad63dc528ae346f7 Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-Tenant-Name: tempest-TestVolumeBootPattern-1410344905 Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Id: default Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Domain-Name: Default Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Id: ae24e34d799e4db292be714fd49579c7 Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: X-User-Name: tempest-TestVolumeBootPattern-1410344905-project Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: method: > Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: exception: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.510225 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: action_args: {'id': 'dd8dc7d7-3d0c-4234-906a-33859e21c0ef'} Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: {{(pid=117872) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 20 09:29:35.511238 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. Jul 20 09:29:35.512806 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: ERROR nova.api.openstack.wsgi Jul 20 09:29:35.514155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: DEBUG nova.api.openstack.wsgi [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Returning 404 to user: Instance dd8dc7d7-3d0c-4234-906a-33859e21c0ef could not be found. {{(pid=117872) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 20 09:29:35.514155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO nova.api.openstack.requestlog [None req-3e627308-df42-4adf-9d8b-0909c7741788 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef" status: 404 len: 111 microversion: 2.1 time: 0.029111 Jul 20 09:29:35.514155 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: [pid: 117872|app: 0|req: 536/1062] 10.222.0.44 () {58 vars in 1235 bytes} [Wed Jul 20 09:29:35 2022] GET /compute/v2.1/servers/dd8dc7d7-3d0c-4234-906a-33859e21c0ef => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 20 09:29:36.802908 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: DEBUG nova.api.openstack.wsgi [None req-a93c68d2-5231-4324-af12-1a2ca3116f50 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] Calling method '.version_select at 0x7fadbc2aaee0>' {{(pid=117871) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 20 09:29:36.806050 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a93c68d2-5231-4324-af12-1a2ca3116f50 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [7cd4c631-6673-40ce-b112-830429ae9915] AMQP server on 10.222.0.44:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 20 09:29:37.813184 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [None req-a93c68d2-5231-4324-af12-1a2ca3116f50 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] [7cd4c631-6673-40ce-b112-830429ae9915] Reconnected to AMQP server on 10.222.0.44:5672 via [amqp] client with port 52092. Jul 20 09:29:37.835009 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO nova.api.openstack.requestlog [None req-a93c68d2-5231-4324-af12-1a2ca3116f50 tempest-TestVolumeBootPattern-1410344905 tempest-TestVolumeBootPattern-1410344905-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-782341406" status: 202 len: 0 microversion: 2.1 time: 1.036025 Jul 20 09:29:37.835573 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: [pid: 117871|app: 0|req: 527/1063] 10.222.0.44 () {58 vars in 1259 bytes} [Wed Jul 20 09:29:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-782341406 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 20 09:31:15.788786 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:31:15.789489 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:31:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:32:53.714446 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:32:53.715066 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Wed Jul 20 09:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:32:59.050695 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:32:59.051423 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Wed Jul 20 09:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:34:35.797080 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:34:35.797669 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:34:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:34:48.778556 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:34:48.779209 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:34:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:34:56.160558 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:34:56.161316 dv-cinder-843309-5-iscsi devstack@n-api.service[117871]: Wed Jul 20 09:34:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 20 09:35:04.315888 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 20 09:35:04.316366 dv-cinder-843309-5-iscsi devstack@n-api.service[117872]: Wed Jul 20 09:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!